Frequently AskedQuestions
Autonomous Generation
What is the baseline for autonomous generation? How does the crawler know what to test?
QApilot’s baseline is zero-touch sanity coverage. The autonomous crawler explores the app like a real user, identified critical flows, and generated executable test cases without any upfront scripting or setup. The outcome is immediate visibility into app health rather than exhaustive regression on Day 1.
How does QApilot's crawler decide what to test?
QApilot explores your app like a real user and builds a knowledge graph of screens, flows, and interactions. This allows it to identify meaningful user journeys and generate test coverage automatically.
What kind of coverage can I expect from autonomous testing?
QApilot focuses on critical user journeys first, providing immediate visibility into app behavior. Coverage expands over time as the system continues exploring and learning.
Do I need to prepare anything before running autonomous testing?
No upfront scripting or setup is required. You can start with your app build, and QApilot handles exploration and test generation automatically.
Can I control what gets generated or explored?
Yes, after the first crawl, once the base knowledge graph is in place, you can guide exploration, prioritize flows, and refine generated coverage based on your testing goals through the "Crawl More" option.
Recording
Why does QApilot ask for an Appium version selection?
QApilot uses Appium under the hood, with additional customizations for stability, healing, and orchestration. Selecting an Appium version ensures compatibility with your existing ecosystem and allows smoother CI/CD integration without unexpected runtime mismatches.
If we use native IDs in the PoC, does that lock us into brittle tests?
No. While native IDs can be leveraged when available, QApilot layers contextual understanding and self-healing on top. This significantly reduces flakiness compared to traditional record-and-playback approaches that rely purely on selectors.
When should I use recording instead of autonomous testing?
Recording is useful when you want to explicitly define specific flows, edge cases, or validations that require precise control.
Are recorded tests reliable as the app changes?
Yes. Recorded tests are supported by AI self-healing, which helps them adapt to UI and flow changes over time.
Can recorded and autonomous tests work together?
Yes. Both are part of the same system and can be combined within the same test suites and execution flows.
Execution
What have we done for CI/CD integration? Can we scale execution?
QApilot is designed to plug directly into CI/CD pipelines and scale execution across multiple devices. Tests can be triggered as part of your pipeline, and parallel execution is supported. Scale depends on the device provider and license configuration, which we size based on your release frequency and device coverage needs.
What devices are available for testing? How do the cloud device farms fit in?
QApilot integrates seamlessly with existing device cloud providers like BrowserStack or LambdaTest. The choice is entirely yours based on availability and existing licenses. QApilot behaves identically regardless of the provider and also includes built-in parallel execution licenses that can be used alongside your existing setup.
How does QApilot integrate with CI/CD pipelines?
QApilot integrates with your CI/CD pipeline to trigger test runs automatically as part of your release process.
Can tests run in parallel across devices?
Yes. QApilot supports parallel execution across multiple devices and environments, depending on your setup.
What environments can I run tests on?
Tests can run on real devices, cloud device farms, or integrated environments based on your infrastructure.
How does QApilot handle flaky tests?
QApilot reduces flakiness through AI self-healing and context-aware execution, ensuring tests remain stable even as the app evolves.
Reporting
Can we customize where execution updates are sent, like Slack channels per app or release?
Yes. Execution notifications are configurable. You can route updates to different Slack channels based on product, environment, or release type, ensuring the right teams get the right signals without noise.
What kind of insights do test reports provide?
Reports include execution results, screenshots, UI metadata, issue detection, and contextual insights to help teams understand failures clearly.
How does QApilot help with debugging failures?
Each failure is mapped to the exact screen and interaction, supported with visual evidence and technical context, making debugging faster.
Can reports be shared with different teams?
Yes. Reports and notifications can be routed to tools like Slack, ensuring the right teams receive relevant updates.
Does QApilot highlight performance or accessibility issues?
Yes. Intelligent bug detection surfaces issues like action latency, page load failures, and accessibility gaps during execution.
Flutter Testing
Why is Flutter testing harder than traditional mobile testing?
Flutter apps often lack stable selectors and involve complex transitions across Flutter, native, and webview contexts, making automation more challenging.
How does QApilot handle Flutter-specific challenges?
QApilot uses context switching, AI-assisted element discovery, and adaptive execution to ensure reliable testing across Flutter-heavy applications.
Can QApilot handle hybrid apps with Flutter and native components?
Yes. QApilot supports seamless interaction across Flutter, native, and webview layers within the same execution flow.
Agentic Architecture
What is QApilot’s agentic architecture?
QApilot is built on a system of specialized AI agents that collaborate using a shared knowledge graph to enable autonomous testing.
What role does the knowledge graph play?
The knowledge graph acts as the central context layer, capturing screens, flows, and interactions and enabling agents to make informed decisions.
Can I integrate my own agents into QApilot?
Yes. QApilot supports Bring Your Own Agent, allowing custom agents to use the knowledge graph and extend testing workflows.
How do custom agents work within the system?
Custom agents can read from the knowledge graph, perform specific tasks, and contribute results back into the system.