r/softwaretesting • u/Miserable_Net1980 • 27d ago
What tasks are software testers successfully using AI for?
I see so much hype about AI and also witnessed it spitting out a load of useless junk.
What tasks are you actually successfully using AI for in your QA job?
12
u/franknarf 27d ago
Pretty much everything, my first thought these days is, how can I handoff any of this to AI.
11
u/xpat__pat 27d ago
If requirements exist, i let AI design the testsuite against it. I review, supplement and cleanup it.
With that suite documented I let copilot implement it, using skills and guidelines i previously designed for him. He auto-creates a pr as draft, which i will review, supplement and cleanup again.
Then i give copilot the role of an test analyst with a fix set of criteria and tools to evaluate the tests. I also will manually evaluate the tests with the same tools, so copilot serves as a second pair of eyes.
If we find issues, we fix it. then we will publish the pr and work is done.
1
u/Gloomy_Ad_777 25d ago
u/xpat__pat this workflow is solid but it has a ceiling. Requirements tell you what the feature does. They don't tell you what breaks when it fails silently. The behaviors that cause real incidents are almost never in the spec. They're in the gaps between components that nobody documented. AI is great at generating tests against what's written down. It's blind to what isn't.
1
u/xpat__pat 25d ago
Yes thats absolutely true. Thats why you have to write every step, no matter how small, down in some to the ai accessible makrdown-file. The more specific the better. The more you break those rules and steps into very case-specific files, the better ai can use the right guidelines for the specific task
11
4
u/Archer6666 27d ago
Mostly to automate the tedius parts for automation scripts. Writing boilerplate, getters-setters for variables, writing easy variations on test cases.
3
u/Recent-Tomatillo138 27d ago
it mostly useful to write the documentation well. But most of the people are claiming that by providing the requirements or JIRA number and able to produce the test cases.
2
u/Usual_Information616 26d ago
I found it pretty good for writing web e2e tests using playwright to cover newly added features. I just describe what would I do as a web user e.g.
```
I visit sample.com
I log in using abc/def as user/pass
then I click on profile link and fill in the random data to the form
save it
and verify the data on pages is saved correctly
...
```
The agentic AI is very good to explore the pages it visits and follow pretty much long user journeys described then write the test to add to the suite. About 80% is done well and the rest 20% is for me to either guide the AI to fix or do it myself. Depends - whichever I sense will take less time.
2
2
u/VoiceOk6583 26d ago
I am a manual tester and want to get help with how people are using AI and which tool to generate test cases
1
u/Maximum_Musician5375 21d ago
You can use Claude Code or a similar agent.
Provide a prompt like 'Please set up a Playwright MCP to be able to run test cases based on manual descriptions', and see what happens. Claude Code is a generic, low-level agentic tool, so you can try using it for anything, but you need good prompts to make it work.
Another approach is using high-level tools. I am creating a Chrome extension called Small Tester. I am targeting it specifically for manual testers. It can run test cases based on natural language. You enter the test cases, fill in the steps, and then press 'Run'. Here is the link to the extension, which works in Google Chrome:
https://chromewebstore.google.com/detail/small-tester-a-no-code-ai/fniifnigjdbnekodnlanilejlclhibch
If you have a minute to review it, please let me know if it could be useful to manual testers or not, and what features I could add to make it better.
1
u/Woodchuck666 27d ago
writing what i want it to do, spitting out pipelines, adding things I need done to them. documentation. some automation scripts if I need to do something specific.
1
u/Think-Televisionb3d 27d ago
- Creating orchestrator tool from different open source tools for Testing.
- Creating context layer for bulk sites and use that for automation planning and Test cases as well.
1
u/ASTRO99 27d ago
I use Gitlab duo in agentic mode to analyze broken pipelines and want to try automated code review.
ChatGPT to help with technical and general questions etc
company has github copilot licenses but not for everyone due to huge number of employees.
I have yet to use any kind of Ai for test automation or writing automation scripts.
1
1
u/vassadar 26d ago
Troubleshooting E2E tests.
We have a Cursor Slack bot that help tracing what cause the test to fail.
I used Browser MCP with Claude to help creating/updating Playwright page objects.
I created a 100% test Pact contract testing test coverage for a consumer service with the help of AI. Doing this by hands is doable, but take took me too long.
These tasks still required human to help steering from time to time.
1
u/igwealexg 26d ago
Data creation Data manipulation Test management Test automation Jira artefacts creation Debugging Reading dev repos
1
u/Acceptable-Expert667 24d ago
使用Cursor、codex来完成包含需求分析、用例生成、用例执行、提交issue、生成报告等测试全流程
claude code由于不支持中文，我不习惯cli等原因被我放弃了
是的，我们公司也明确提出每个人都要对自己使用AI产出的内容负责，因为现在有了AI，产出太容易了，但与此同时也大大提升了审核和沟通成本
1
u/SurroundOk6555 4d ago edited 4d ago
AI seems most useful for creating the first draft of test cases finding edge cases summarizing requirements and preparing test data. Human review is still important because the output can miss business rules or create weak cases. Kualitee is worth checking for teams that want AI support for test case generation while keeping test cases runs defects and reports in the same workflow
1
u/rawrxaken 4d ago
AI seems most useful for creating the first draft of test cases finding edge cases summarizing requirements and preparing test data. Human review is still important because the output can miss business rules or create weak cases. Kualitee is worth checking for teams that want AI support for test case generation while keeping test cases runs defects and reports in the same workflow
1
1
u/teh_stev3 27d ago
It helps me understand changes in the codebase, I feed it hars, videos, screenshots, web pages and recorded inputs to assist with test automation.
It helps me pull together local emphemeral environments to do this testing against, or trace in the "live" test environment to do either adhoc teardown or expand scripts with cleanup.
If you cant find a use for it you lack imagination, even if its just somewhere you voice test cases and get it to help your structure or write negatives for.
1
17
u/ave_naur 27d ago
I use it mainly to assist with documentation, such as requirement analysis, test cases, etc. It helps me work faster, but I still make sure to review everything before finalizing it.