iOS自动化测试指南：使用xcodebuild与Xcode模拟器进行QA测试

qa-testing-ios by vasilyu1983/ai-agents-public

85 周安装量

49 GitHub Stars

GitHub

安装命令

npx skills add https://github.com/vasilyu1983/ai-agents-public --skill qa-testing-ios

iOS 自动化测试

🇨🇳中文介绍

QA 测试 (iOS)

使用 xcodebuild + Xcode 模拟器 (simctl) 来构建、运行和稳定 iOS 测试。

主要文档 : XCTest, Swift Testing, simctl, Xcode testing

需要确认的输入项

Xcode 入口点: -workspace 或 -project
-scheme (以及可选的 -testPlan)
目标设备: 模拟器名称 + iOS 运行时 (或 OS=latest)，以及是否需要真机

广告位招租

在这里展示您的产品或服务

触达数万 AI 开发者，精准高效

联系我们

相关 Skills

FlyClaw：零登录航班聚合查询工具，Python实现多源航班信息与价格搜索

4,000,000 周安装

Azure RBAC 权限管理工具：查找最小角色、创建自定义角色与自动化分配

135,700 周安装

Skills CLI 使用指南：AI Agent 技能包管理器安装与管理教程

44,900 周安装

README 国际化工具：自动化翻译与多语言文档管理 | readme-i18n

44,000 周安装

UI 测试钩子: 启动参数/环境变量开关 (存根、演示数据、认证绕过、禁用动画)

产物需求: xcresult、覆盖率、截图/视频、日志

任务	命令
列出方案	`xcodebuild -list -workspace MyApp.xcworkspace`
列出模拟器	`xcrun simctl list devices`
列出设备 (USB)	`xcrun xctrace list devices`
启动模拟器	`xcrun simctl boot "iPhone 15 Pro"`
等待启动完成	`xcrun simctl bootstatus booted -b`
构建应用	`xcodebuild build -scheme MyApp -sdk iphonesimulator`
安装应用	`xcrun simctl install booted app.app`
运行测试	`xcodebuild test -scheme MyApp -destination 'platform=iOS Simulator,name=iPhone 15 Pro,OS=latest' -resultBundlePath TestResults.xcresult`
运行测试 (真机)	`xcodebuild test -scheme MyApp -destination 'platform=iOS,id=<UDID>' -resultBundlePath TestResults.xcresult`
重置模拟器	`xcrun simctl shutdown all && xcrun simctl erase all`
截图	`xcrun simctl io booted screenshot screenshot.png`
录制视频	`xcrun simctl io booted recordVideo recording.mov`

解析构建输入项 (workspace/project, scheme, testPlan, 目标设备)。
使模拟器状态可重复：根据需要关闭/擦除、启动并等待启动完成。
启用产物运行测试 (-resultBundlePath)；仅在适当时进行并行化和重试。
从 xcresult 包中分析失败；通过重复测试确认偶发性失败；指定负责人和复现步骤进行隔离。

选择要复现的测试: -only-testing:TargetTests/ClassName/testMethod 和 -skip-testing:TargetTests/FlakyClass。
大型测试套件优先使用测试计划: -testPlan <plan> (保持设备/配置/运行一致)。
当测试套件是隔离安全的时启用并行测试: -parallel-testing-enabled YES (+ -maximum-parallel-testing-workers N)。
在自动化中始终写入结果包: -resultBundlePath TestResults.xcresult。
对于重新运行，拆分构建和测试: xcodebuild build-for-testing ... 然后 xcodebuild test-without-building ...。
本地检查结果: open TestResults.xcresult 或 xcrun xcresulttool get --path TestResults.xcresult --format json。

偶发性失败分析 (重复与重试)

在添加重试之前，优先使用重复测试来证明偶发性失败率。
在全套件重试之前，使用有针对性的重新运行。

常见模式 (标志因 Xcode 版本而异):

在 CI 中重试失败的测试一次: -retry-tests-on-failure -test-iterations 2
测量偶发性直到首次失败: -test-iterations 50 -test-repetition-mode until-failure
重复运行单个测试: -only-testing:TargetTests/ClassName/testMethod -test-iterations 20

层级	框架	范围
单元测试	XCTest / Swift Testing	业务逻辑 (快速)
快照测试	XCTest + 快照库	视图渲染
集成测试	XCTest	持久化、网络
UI 测试	XCUITest	关键用户旅程

默认: PR 门禁使用模拟器；发布版本使用真机
覆盖: 一部小屏手机、一部大屏手机，如果支持则加上 iPad
仅当支持多个主要版本时才添加操作系统版本

偶发性失败控制

除非项目有特殊要求，否则使用以下默认设置:

在 UI 测试构建中禁用或减少动画。
固定区域设置/时区 (通过启动参数或应用级配置)。
在边界处对网络进行存根处理 (避免在 UI 测试中进行真实的第三方调用)。
在测试之间重置应用状态 (全新安装、深度链接重置或显式清理)。
优先使用基于状态的等待 (waitForExistence, expectations) 而非休眠。
尽可能预先授予/重置权限 (模拟器): xcrun simctl privacy booted grant ...。

CI 集成 (GitHub Actions)

name: iOS CI
on: [push, pull_request]
jobs:
  test:
    runs-on: macos-15
    steps:
      - uses: actions/checkout@v4
      - uses: maxim-lobanov/setup-xcode@v1
        with:
          xcode-version: "16.0"
      - run: |
          set -euo pipefail
          xcodebuild test \
            -scheme MyApp \
            -sdk iphonesimulator \
            -destination 'platform=iOS Simulator,name=iPhone 15 Pro,OS=latest' \
            -resultBundlePath TestResults.xcresult
      - uses: actions/upload-artifact@v4
        if: always()
        with:
          name: test-results
          path: TestResults.xcresult

使 UI 测试独立且幂等
使用测试数据构建器和专用的测试账户
失败时收集 xcresult 包
使用 accessibilityIdentifier，而非标签

依赖测试顺序或全局状态
UI 测试需要真实网络
使用 Thread.sleep() 进行同步
未经验证就接受 AI 建议的选择器

资源	用途
references/swift-testing.md	Swift Testing 框架
references/simulator-commands.md	完整的 simctl 参考
references/xctest-patterns.md	XCTest/XCUITest 模式
references/xcuitest-patterns.md	XCUITest UI 测试模式
references/snapshot-testing-ios.md	视觉快照测试
references/ios-ci-optimization.md	CI 流水线优化

模板	用途
assets/template-ios-ui-test-stability-checklist.md	稳定性检查清单

技能	用途
software-mobile	iOS 开发
qa-testing-strategy	测试策略
qa-testing-mobile	跨平台移动端

在最终回答之前，使用网络搜索/网络获取来验证当前的外部事实、版本、价格、截止日期、法规或平台行为。
优先使用原始来源；对于易变信息，报告来源链接和日期。
如果无法访问网络，请说明限制并将指南标记为未经验证。

🇺🇸English

QA Testing (iOS)

Use xcodebuild + Xcode Simulator (simctl) to build, run, and stabilize iOS tests.

Primary docs : XCTest, Swift Testing, simctl, Xcode testing

Inputs to Confirm

Xcode entrypoint: -workspace or -project
-scheme (and optional -testPlan)
Destination(s): simulator name + iOS runtime (or OS=latest), and whether real devices are required
UI-test hooks: launch arguments/env toggles (stubs, demo data, auth bypass, disable animations)
Artifact needs: xcresult, coverage, screenshots/video, logs

Quick Commands

Task	Command
List schemes	`xcodebuild -list -workspace MyApp.xcworkspace`
List simulators	`xcrun simctl list devices`
List devices (USB)	`xcrun xctrace list devices`
Boot simulator	`xcrun simctl boot "iPhone 15 Pro"`
Wait for boot	`xcrun simctl bootstatus booted -b`
Build app	`xcodebuild build -scheme MyApp -sdk iphonesimulator`

Workflow

Resolve build inputs (workspace/project, scheme, testPlan, destinations).
Make simulator state repeatable: shutdown/erase as needed, boot, and wait for boot.
Run tests with artifacts enabled (-resultBundlePath); parallelize and retry only when appropriate.
Triage failures from the xcresult bundle; confirm flakes with repetition; quarantine with an owner and reproduction steps.

xcodebuild Patterns

Select tests to reproduce: -only-testing:TargetTests/ClassName/testMethod and -skip-testing:TargetTests/FlakyClass.
Prefer test plans for large suites: -testPlan <plan> (keeps device/config/runs consistent).
Enable parallel testing when suites are isolation-safe: -parallel-testing-enabled YES (+ -maximum-parallel-testing-workers N).
Always write a result bundle in automation: -resultBundlePath TestResults.xcresult.
For reruns, split build and test: xcodebuild build-for-testing ... then xcodebuild test-without-building ....
Inspect results locally: open TestResults.xcresult or .

Flake Triage (Repetition and Retry)

Prefer repetition to prove flake rate before adding retries.
Use targeted reruns before suite-wide retries.

Common patterns (flags vary by Xcode version):

Retry failing tests once in CI: -retry-tests-on-failure -test-iterations 2
Measure flakiness until first failure: -test-iterations 50 -test-repetition-mode until-failure
Run a single test repeatedly: -only-testing:TargetTests/ClassName/testMethod -test-iterations 20

Testing Layers

Layer	Framework	Scope
Unit	XCTest / Swift Testing	Business logic (fast)
Snapshot	XCTest + snapshot libs	View rendering
Integration	XCTest	Persistence, networking
UI	XCUITest	Critical user journeys

Device Matrix

Default: simulators for PR gates; real devices for release
Cover: one small phone, one large phone, iPad if supported
Add OS versions only for multiple major release support

Flake Control

Use these defaults unless the project requires otherwise:

Disable or reduce animations in UI-test builds.
Fix locale/timezone (via launch arguments or app-level configuration).
Stub network at the boundary (avoid real third-party calls in UI tests).
Reset app state between tests (fresh install, deep-link reset, or explicit teardown).
Prefer state-based waits (waitForExistence, expectations) over sleeps.
Pre-grant/reset permissions where possible (simulators): xcrun simctl privacy booted grant ....

CI Integration (GitHub Actions)

name: iOS CI
on: [push, pull_request]
jobs:
  test:
    runs-on: macos-15
    steps:
      - uses: actions/checkout@v4
      - uses: maxim-lobanov/setup-xcode@v1
        with:
          xcode-version: "16.0"
      - run: |
          set -euo pipefail
          xcodebuild test \
            -scheme MyApp \
            -sdk iphonesimulator \
            -destination 'platform=iOS Simulator,name=iPhone 15 Pro,OS=latest' \
            -resultBundlePath TestResults.xcresult
      - uses: actions/upload-artifact@v4
        if: always()
        with:
          name: test-results
          path: TestResults.xcresult

Do / Avoid

Do

Make UI tests independent and idempotent
Use test data builders and dedicated test accounts
Collect xcresult bundles on failure
Use accessibilityIdentifier, not labels

Avoid

Relying on test ordering or global state
UI tests requiring real network
Thread.sleep() for synchronization
Accepting AI-proposed selectors without validation

Resources

Resource	Purpose
references/swift-testing.md	Swift Testing framework
references/simulator-commands.md	Complete simctl reference
references/xctest-patterns.md	XCTest/XCUITest patterns
references/xcuitest-patterns.md	XCUITest UI testing patterns
references/snapshot-testing-ios.md	Visual snapshot testing
references/ios-ci-optimization.md	CI pipeline optimization

Templates

Template	Purpose
assets/template-ios-ui-test-stability-checklist.md	Stability checklist

Related Skills

Skill	Purpose
software-mobile	iOS development
qa-testing-strategy	Test strategy
qa-testing-mobile	Cross-platform mobile

Fact-Checking

Use web search/web fetch to verify current external facts, versions, pricing, deadlines, regulations, or platform behavior before final answers.
Prefer primary sources; report source links and dates for volatile information.
If web access is unavailable, state the limitation and mark guidance as unverified.

Weekly Installs

Repository

vasilyu1983/ai-…s-public

GitHub Stars

First Seen

Jan 23, 2026

Security Audits

Gen Agent Trust HubPass SocketPass SnykPass

Installed on

codex69

opencode69

cursor68

gemini-cli67

github-copilot64

amp59

GitHub Actions 官方文档查询助手 - 精准解答 CI/CD 工作流问题

43,400 周安装

xcrun xcresulttool get --path TestResults.xcresult --format json