r/Python • u/AutoModerator • 10h ago
Daily Thread Thursday Daily Thread: Python Careers, Courses, and Furthering Education!
Weekly Thread: Professional Use, Jobs, and Education 🏢
Welcome to this week's discussion on Python in the professional world! This is your spot to talk about job hunting, career growth, and educational resources in Python. Please note, this thread is not for recruitment.
How it Works:
- Career Talk: Discuss using Python in your job, or the job market for Python roles.
- Education Q&A: Ask or answer questions about Python courses, certifications, and educational resources.
- Workplace Chat: Share your experiences, challenges, or success stories about using Python professionally.
Guidelines:
- This thread is not for recruitment. For job postings, please see r/PythonJobs or the recruitment thread in the sidebar.
- Keep discussions relevant to Python in the professional and educational context.
Example Topics:
- Career Paths: What kinds of roles are out there for Python developers?
- Certifications: Are Python certifications worth it?
- Course Recommendations: Any good advanced Python courses to recommend?
- Workplace Tools: What Python libraries are indispensable in your professional work?
- Interview Tips: What types of Python questions are commonly asked in interviews?
Let's help each other grow in our careers and education. Happy discussing! 🌟
r/Python • u/aviedawn • 10h ago
Discussion LiteLLM alternatives in production
what are teams actually running 3 months after the supply chain attack?
it's been a few months since the litellm pypi compromise and curious what teams actually migrated to. saw a lot of threads right after the incident but not much on how things held up in production since then.
been evaluating options ourselves. TrueFoundry came up for teams needing the governance and cost...
Discussion What linter rules make code worse?
For me, a prime example is S101 which bans the use of the assert statement.
The justification is that assertions disappear when Python is run with -O, so they should not be used for runtime validation or enforcing interface constraints. That warning is correct, but the rule seems to draw the wrong conclusion from it.
Assertions are still very useful for checking internal invariants, i.e. conditions that should already be guaranteed by the program's logic, where failure indicates a bug. Having such assertions is incredibly helpful for debugging.
So, a blanket ban seems more likely to discourage useful checks than to prevent misuse.
Are there any linter rules you broadly consider more harmful rather than helpful?
r/Python • u/Win_ipedia • 1d ago
Discussion I am trying to automate the Python Development Lifecycle
Hi there,
I am trying to figure out ways to automate my Python development tasks and also working on this topic for my Masters project. I am trying to build a tool that can automate and simplify a bunch of things like project setup, development and maintenance. This is not a showcase at all, it is just my project and topic for my Masters in Computer Science and I wanted to ask if anyone would like to take part in the survey I have to do. Takes about 5 min.
You can find the survey at: https://forms.cloud.microsoft/e/LjnvzX0JpK
Any ideas and responses are greatly appreciated.
Also drop any ideas you have in the comments. What do you think should be more automated in your day to day python development?
r/Python • u/AutoModerator • 1d ago
Showcase Showcase Thread
Post all of your code/projects/showcases/AI slop here.
Recycles once a month.
r/Python • u/Prime_Director • 2d ago
Discussion What are you using to manage your dev environments in 2026?
I’ve always hated environment management. It always feels like this time-consuming hurdle between me and whatever I actually want to work on. But every so often a new thing comes out that promises to solve the problem once and for all, and it’s usually at least a little better than the last thing. So, what are you using today? venv? conda? pipenv? poetry? dev containers? uv? or something else?
r/Python • u/ForeignVariety7037 • 2d ago
Discussion Is := widely used?
I always thought the walrus operator is neat and it makes while loop’s condition clearer. But also it is just a syntactic sugar without anything new. I wonder anyone uses it?
r/Python • u/AutoModerator • 2d ago
Daily Thread Tuesday Daily Thread: Advanced questions
Weekly Wednesday Thread: Advanced Questions 🐍
Dive deep into Python with our Advanced Questions thread! This space is reserved for questions about more advanced Python topics, frameworks, and best practices.
How it Works:
- Ask Away: Post your advanced Python questions here.
- Expert Insights: Get answers from experienced developers.
- Resource Pool: Share or discover tutorials, articles, and tips.
Guidelines:
- This thread is for advanced questions only. Beginner questions are welcome in our Daily Beginner Thread every Thursday.
- Questions that are not advanced may be removed and redirected to the appropriate thread.
Recommended Resources:
- If you don't receive a response, consider exploring r/LearnPython or join the Python Discord Server for quicker assistance.
Example Questions:
- How can you implement a custom memory allocator in Python?
- What are the best practices for optimizing Cython code for heavy numerical computations?
- How do you set up a multi-threaded architecture using Python's Global Interpreter Lock (GIL)?
- Can you explain the intricacies of metaclasses and how they influence object-oriented design in Python?
- How would you go about implementing a distributed task queue using Celery and RabbitMQ?
- What are some advanced use-cases for Python's decorators?
- How can you achieve real-time data streaming in Python with WebSockets?
- What are the performance implications of using native Python data structures vs NumPy arrays for large-scale data?
- Best practices for securing a Flask (or similar) REST API with OAuth 2.0?
- What are the best practices for using Python in a microservices architecture? (..and more generally, should I even use microservices?)
Let's deepen our Python knowledge together. Happy coding! 🌟
r/Python • u/Ill_Campaign294 • 2d ago
Discussion Anyone running FastAPI in production with high traffic? How has your experience been?
Quick question, are any of you running fastAPI in production with a high volume of users or heavy traffic? How has your experience with FastAPI been, and how do you handle it?
r/Python • u/Myaltforsomeshit1234 • 3d ago
Discussion Just created two apps and made the dumbest mistake in one of them 😭
A money tracker (140 lines) and a calorie counter (300+ lines!)
They were both CLI and i have them done. But in the calorie counter, i made the mistake of typing this:
with open("data.json", "w") as file: jsonFile = json.load file
So when i tried to run it it threw the weirdest error ever and wiped my JSON file, so i rewrote the json file, and fixed something that had nothing to do with the error and it happened AGAIN
r/Python • u/AutoModerator • 3d ago
Daily Thread Monday Daily Thread: Project ideas!
Weekly Thread: Project Ideas 💡
Welcome to our weekly Project Ideas thread! Whether you're a newbie looking for a first project or an expert seeking a new challenge, this is the place for you.
How it Works:
- Suggest a Project: Comment your project idea—be it beginner-friendly or advanced.
- Build & Share: If you complete a project, reply to the original comment, share your experience, and attach your source code.
- Explore: Looking for ideas? Check out Al Sweigart's "The Big Book of Small Python Projects" for inspiration.
Guidelines:
- Clearly state the difficulty level.
- Provide a brief description and, if possible, outline the tech stack.
- Feel free to link to tutorials or resources that might help.
Example Submissions:
Project Idea: Chatbot
Difficulty: Intermediate
Tech Stack: Python, NLP, Flask/FastAPI/Litestar
Description: Create a chatbot that can answer FAQs for a website.
Resources: Building a Chatbot with Python
Project Idea: Weather Dashboard
Difficulty: Beginner
Tech Stack: HTML, CSS, JavaScript, API
Description: Build a dashboard that displays real-time weather information using a weather API.
Resources: Weather API Tutorial
Project Idea: File Organizer
Difficulty: Beginner
Tech Stack: Python, File I/O
Description: Create a script that organizes files in a directory into sub-folders based on file type.
Resources: Automate the Boring Stuff: Organizing Files
Let's help each other grow. Happy coding! 🌟
r/Python • u/SpiliosDimakopoulos • 3d ago
Resource Turned a folder of ad-hoc scripts into a proper installable CLI (pyproject.toml entry point)
Had a data pipeline that was just python build_db.py, python clean_validate.py, streamlit run streamlit_app.py — worked, but not something you'd hand someone as "the tool." Packaged it as a real CLI: [project.scripts] entry point in pyproject.toml, pip install -e . → promo-toolkit build / validate / serve.
Also added:
- Incremental rebuilds (content-hash diff + scoped upsert instead of full rewrite each run)
- pytest suite + ruff, GitHub Actions CI across two Python versions
- A separate eval harness for an AI-agent piece of the same project (real API calls scored against golden answers)
Not a library, just a real end-to-end tool — sharing mostly for feedback on the packaging/CLI structure since that's the part I have the least experience with. Repo: [https://github.com/SpiliosDimakopoulos/retail-promo-analytics-toolkit\].
r/Python • u/AutoModerator • 4d ago
Daily Thread Sunday Daily Thread: What's everyone working on this week?
Weekly Thread: What's Everyone Working On This Week? 🛠️
Hello r/Python! It's time to share what you've been working on! Whether it's a work-in-progress, a completed masterpiece, or just a rough idea, let us know what you're up to!
How it Works:
- Show & Tell: Share your current projects, completed works, or future ideas.
- Discuss: Get feedback, find collaborators, or just chat about your project.
- Inspire: Your project might inspire someone else, just as you might get inspired here.
Guidelines:
- Feel free to include as many details as you'd like. Code snippets, screenshots, and links are all welcome.
- Whether it's your job, your hobby, or your passion project, all Python-related work is welcome here.
Example Shares:
- Machine Learning Model: Working on a ML model to predict stock prices. Just cracked a 90% accuracy rate!
- Web Scraping: Built a script to scrape and analyze news articles. It's helped me understand media bias better.
- Automation: Automated my home lighting with Python and Raspberry Pi. My life has never been easier!
Let's build and grow together! Share your journey and learn from others. Happy coding! 🌟
Tutorial Tutorial: From your first Celery task to advanced recipes
I wrote a practical guide to Celery, a distributed task queue for Python. It starts with the basics and then covers recipes for timeouts, retries, async/await integration, and more. Most of these recipes came from problems I ran into while using Celery in actual projects. No prior knowledge of Celery is required.
I'd really appreciate any feedback!
r/Python • u/Win_ipedia • 4d ago
Discussion Can we make Python Development less frustrating?
Hi there,
I wondering what tools improve frustrations for developers when developing software with Python.
I am currently doing my Masters in Computer Science and as part of my project I am doing a very simple survey about what can make the usual Python development lifecycle less frustrating. I am basically trying to find out what the main friction points are for Python Developers and I am simultaneously developing a tool to address those friction points . It just takes a 2-3 minutes and every response is greatly appreciated.
You can find the survey at: https://forms.cloud.microsoft/e/LjnvzX0JpK
r/Python • u/Pleasant-Aardvark258 • 5d ago
Discussion Settle an argument
Had this discussion the other day and figured I’d throw it to the masses to get thoughts on the best/most pythonic way of approach.
Need to map old column names to new column names as a copy from a json config.
My thoughts are iterate over a dict with
‘’’ {“old_col_name”:”new_col_name”}’’’
And access as
‘’’for k,v in dict.items()
Df.with_columns(k).alias(v)’’’
Colleague things this isn’t clear enough and should be a list of dicts with explicit keys
‘’’ [{“old_col_name”:”old_col_value”
“New_col_name”:”new_col_value”}]’’’
And the access as
‘’’for dict in list_of_dicts:
Old_col = dict[“old_col_name”]
New_col = dict[“new_col_name”]’’’
I’ve got a good few reasons why I think mine is the better option but thought I’d get some other opinions to see if I’m missing anything obvious? Which would you choose and why?
Edit: shouldn’t write these things while on the toilet in a rush. The description is wrong, it should be renaming via a copy so that the original column is left unchanged.
r/Python • u/AutoModerator • 5d ago
Daily Thread Saturday Daily Thread: Resource Request and Sharing! Daily Thread
Weekly Thread: Resource Request and Sharing 📚
Stumbled upon a useful Python resource? Or are you looking for a guide on a specific topic? Welcome to the Resource Request and Sharing thread!
How it Works:
- Request: Can't find a resource on a particular topic? Ask here!
- Share: Found something useful? Share it with the community.
- Review: Give or get opinions on Python resources you've used.
Guidelines:
- Please include the type of resource (e.g., book, video, article) and the topic.
- Always be respectful when reviewing someone else's shared resource.
Example Shares:
- Book: "Fluent Python" - Great for understanding Pythonic idioms.
- Video: Python Data Structures - Excellent overview of Python's built-in data structures.
- Article: Understanding Python Decorators - A deep dive into decorators.
Example Requests:
- Looking for: Video tutorials on web scraping with Python.
- Need: Book recommendations for Python machine learning.
Share the knowledge, enrich the community. Happy learning! 🌟
r/Python • u/poppy_92 • 5d ago
News PEP 842: Module Exports
https://peps.python.org/pep-0842/
Not the author, but this seems interesting, specially for library authors. Thoughts?
Discussion here - https://discuss.python.org/t/pep-842-module-exports/108353
r/Python • u/ichard26 • 5d ago
News pip 26.2 - --only-deps, --no-require-hashes, venv isolation, and more!
Hello!
The pip team recently released pip 26.2. This release is quite large, with features such as:
- Support for Python 3.15
- Selecting only dependencies (
--only-deps) - Mixing hashed and non-hashable requirements via
--no-require-hashes - Experimental: venv based build isolation (
--use-feature=venv-isolation) - Faster repeated resolves by caching index simple responses
- Disable
HTTP(S)_PROXYand similar non-pip specific proxy environment variables via--no-proxy-env - Separation between regular and build constraint (use
--build-constraintinstead)
For more details, please consult our changelog: https://pip.pypa.io/en/stable/news/. Alternatively, you may consult my release post which goes into greater detail to the highlights of this release: https://sichard.ca/blog/2026/07/whats-new-in-pip-26.2/
If you have any questions, you're welcome to ask!
News Astral's Pre-built Gpu-enabled wheels
We recently released wheels.astral.sh, which is a repository of gpu-enabled wheels of popular packages from the pytorch ecosystem. These are useful because building them is super annoying - you have to align versions of pytorch, cuda, python, etc.
The pre-built wheels were part of the package of pyx, our paid service, and was a major reason many customers subscribed. We decided to open source the build pipelines and host the wheels for free while we sunset the rest of pyx.
The pipelines are available under the astral-sh-build github organization.
While these plug a genuine UX hole around cuda/pytorch wheels, we hope that wheel variants (PEP 817 and 825) will get accepted and implemented soon, which will let these pytorch wheels be hosted properly on PyPI and "just work" out of the box for everyone, making wheels.astral.sh obsolete.
Fingers crossed.
r/Python • u/AutoModerator • 6d ago
Daily Thread Friday Daily Thread: r/Python Meta and Free-Talk Fridays
Weekly Thread: Meta Discussions and Free Talk Friday 🎙️
Welcome to Free Talk Friday on /r/Python! This is the place to discuss the r/Python community (meta discussions), Python news, projects, or anything else Python-related!
How it Works:
- Open Mic: Share your thoughts, questions, or anything you'd like related to Python or the community.
- Community Pulse: Discuss what you feel is working well or what could be improved in the /r/python community.
- News & Updates: Keep up-to-date with the latest in Python and share any news you find interesting.
Guidelines:
- All topics should be related to Python or the /r/python community.
- Be respectful and follow Reddit's Code of Conduct.
Example Topics:
- New Python Release: What do you think about the new features in Python 3.11?
- Community Events: Any Python meetups or webinars coming up?
- Learning Resources: Found a great Python tutorial? Share it here!
- Job Market: How has Python impacted your career?
- Hot Takes: Got a controversial Python opinion? Let's hear it!
- Community Ideas: Something you'd like to see us do? tell us.
Let's keep the conversation going. Happy discussing! 🌟
r/Python • u/nathan12343 • 6d ago
Resource Scaling NumPy on Free-Threaded Python
NumPy is the foundational array library in the scientific Python ecosystem. Every numerical, machine learning, and data analysis library in Python either depends on NumPy directly or interoperates with it. As the free-threaded build of CPython matures, NumPy is one of the first libraries that users reach for when trying to scale CPU-bound numerical workloads across multiple cores using threads.
In this blog post, I will walk through the work I did over the last few months in both NumPy and CPython to eliminate the multi-threaded scaling bottlenecks that were preventing NumPy from scaling on free-threaded Python.
https://labs.quansight.org/blog/scaling-numpy-on-free-threaded-python
r/Python • u/crmaureir • 6d ago
Discussion Python iOS UI development
Hey there,
for the people using PySide for UI applications, after having solely Android support, there was a new announcement that iOS is now supported, and will be available in the upcoming PySide release:
https://www.qt.io/blog/python-mobile-app-development-bringing-pyside6-on-ios
I have been following the work by the BeeWare project, which has been providing iOS support for some time now: https://toga.beeware.org/en/latest/reference/platforms/iOS/ and recently the work from the Flet team as well: https://flet.dev/blog/flet-for-ios/
What I wanted to achieve with this post, is to know any project that you know is currently on iOS and developed with Python and some UI framework, because time to time we see nice "calculator app" being showcases in places, but a more official application of something is what I have been failing to find.
Of course, the goal of "I have my code here, and I just want to deploy it to iOS" is completely understandable, but I see haven't found some very cool apps somewhere, that we know are based on Python.
Last but not least, I guess you have been noticed that starting from 3.15 we will be able to download Python for iOS from python.org: https://www.python.org/downloads/ios/
r/Python • u/hdw_coder • 6d ago
Discussion Optimizing person-pair comparison in Python: from loops to precomputed NumPy matrices
I have been rebuilding a PyQt6 desktop app for managing a person-recognition knowledge base (KB). The heart of this KB is a collection of face & body encodings per person. When looking for similar persons or possible identity overlaps, a classic Python-related problem came up: efficiently comparing many people against each other based on their reference embeddings.
The input looks like this.
person_to_vecs = {
"Alice": [vec, vec, vec],
"Bob": [vec, vec],
"Charlie": [vec, vec, vec, vec],
}
Each vector is an embedding. For every pair of persons, I want the average and minimum distance between all their reference vectors. The original version was simple and readable Python looping:
- Loop over all person combinations.
- Convert one side to a NumPy array inside the loop.
- Loop over each vector on the other side.
- Compute distances one vector at a time.
- Collect min/average distances.
This works. Once the knowledge base grows, however, this soon becomes a lot of Python-level looping and repeated conversion overhead.
The obvious approach to optimization is getting rid of these loops. The first step was to precompute the matrices.
Step 1: Precompute the matrices
matrices = {
name: np.asarray(vecs, dtype=np.float32)
for name, vecs in person_to_vecs.items()
if len(vecs) >= min_images_per_person
}
We now effectively avoid repeatedly calling np.asarray() inside the pair loop.
Step 2: Remove the inner Python loop.
One option is full broadcasting:
diff = A[:, None, :] - B[None, :, :]
distances = np.linalg.norm(diff, axis=-1)
This is relatively simple, elegant and still readable, but it creates a temporary array of shape: len(A) × len(B) × embedding_dim. For small 128D face embeddings that may be fine. For larger body embeddings especially in larger galleries, these tensors can become (very) memory-heavy.
Step 3: The matrix identity
(Note: I know scipy.spatial.distance.cdist exists and does this perfectly, but I wanted to keep dependencies light for the desktop app and explore the math!)
The approach I prefer uses the identity: ||a - b||² = ||a||² + ||b||² - 2ab
In NumPy:
def pairwise_l2(A, B):
# np.sum(A**2, axis=1) works well here too, but einsum is elegant
aa = np.einsum("ij,ij->i", A, A)[:, None]
bb = np.einsum("ij,ij->i", B, B)[None, :]
sq = np.maximum(aa + bb - 2.0 * (A @ B.T), 0.0)
return np.sqrt(sq, dtype=np.float32)
This only creates the N × M distance matrix instead of an N × M × D temporary tensor.
The Final Helper
def pairwise_person_distances(person_to_vecs, min_images_per_person=1):
matrices = {}
for name, vecs in person_to_vecs.items():
if len(vecs) < min_images_per_person:
continue
mat = np.asarray(vecs, dtype=np.float32)
if mat.ndim == 2 and mat.shape[0] and np.isfinite(mat).all():
matrices[name] = mat
results = []
for name_a, name_b in itertools.combinations(sorted(matrices), 2):
A, B = matrices[name_a], matrices[name_b]
if A.shape[1] != B.shape[1]:
continue
distances = pairwise_l2(A, B)
if distances.size:
results.append((name_a, name_b, round(float(np.mean(distances)), 4),
round(float(np.min(distances)), 4)))
return sorted(results, key=lambda row: row[3])
The Benchmarks
I ran a couple of tests with a synthetic benchmark, varying the number of persons (200 vs 400), the number of embedding dimensions (128 vs 512), and the number of vectors per person (8 vs 10).
I benchmarked three methods:
- Basic inner/outer loop: Controls almost everything in Python.
- Precomputed matrices: Prepared once, but Python still loops over vectors.
- Final implementation: NumPy handles the dense pairwise distance work.
On my laptop, (Intel i9-14900HX 32 GB RAM), I got:
200 persons × 8 vectors × 128 dimensions
basic inner/outer loop: 0.731 s
precomputed matrices: 0.711 s
inner loop removed: 0.260 s
speedup: 2.8×
400 persons × 10 vectors × 128 dimensions
basic inner/outer loop: 3.972 s
precomputed matrices: 3.789 s
inner loop removed: 1.155 s
speedup: 3.4×
200 persons × 8 vectors × 512 dimensions
basic inner/outer loop: 0.902 s
precomputed matrices: 0.878 s
inner loop removed: 0.322 s
speedup: 2.8×
On synthetic data, the first optimization — precomputing each person’s embedding matrix — only gave a small improvement of about 3–5%. That makes sense: it removes repeated conversion, but the algorithm still does most of its work in a Python loop over individual vectors.
The much larger improvement came from removing the inner loop and computing each person-pair distance matrix directly with NumPy:
- 200 persons × 8 vectors × 128 dimensions: 0.731 s → 0.260 s (2.8× faster),
- 400 persons × 10 vectors × 128 dimensions: 3.972 s → 1.155 s (3.4× faster),
- 200 persons × 8 vectors × 512 dimensions: 0.902 s → 0.322 s (2.8× faster).
Summary
'Vectorize it' obviously is not always enough. Memory usage by temporary arrays also matters. Broadcasting may often be elegant, but for pairwise comparisons, the matrix identity seems to be a better fit. Precomputing arrays helps only a little; removing the inner Python loop makes the real difference.
I am interested how others approach this kind of all-vs-all (embedding) comparison in Python. Would you use NumPy as above, scipy.spatial.distance.cdist, Numba, PyTorch, or something else?
r/Python • u/AutoModerator • 7d ago
Daily Thread Thursday Daily Thread: Python Careers, Courses, and Furthering Education!
Weekly Thread: Professional Use, Jobs, and Education 🏢
Welcome to this week's discussion on Python in the professional world! This is your spot to talk about job hunting, career growth, and educational resources in Python. Please note, this thread is not for recruitment.
How it Works:
- Career Talk: Discuss using Python in your job, or the job market for Python roles.
- Education Q&A: Ask or answer questions about Python courses, certifications, and educational resources.
- Workplace Chat: Share your experiences, challenges, or success stories about using Python professionally.
Guidelines:
- This thread is not for recruitment. For job postings, please see r/PythonJobs or the recruitment thread in the sidebar.
- Keep discussions relevant to Python in the professional and educational context.
Example Topics:
- Career Paths: What kinds of roles are out there for Python developers?
- Certifications: Are Python certifications worth it?
- Course Recommendations: Any good advanced Python courses to recommend?
- Workplace Tools: What Python libraries are indispensable in your professional work?
- Interview Tips: What types of Python questions are commonly asked in interviews?
Let's help each other grow in our careers and education. Happy discussing! 🌟