The Fastlane UI Test are not using the prepared/booted simulator

[krystofwoldrich]

GitHub action Run Link

https://github.com/getsentry/sentry-cocoa/actions/runs/14470395237/job/40582568426?pr=5093

Description

While investigating Meastro tests flakiness, I've noticed the fastlane UI tests are not using the simulator which is booted/prepared before the tests in the CI job.

Example:
iPhone 16 is prepared

But Clone 1 of iPhone 16 Pro is used for the test

More examples

This boots iPhone 16 but runs tests on iPhone 15 Pro https://github.com/getsentry/sentry-cocoa/actions/runs/14470395237/job/40582569691?pr=5093

[philprime]

I found these fastlane options we can explore:

$ bundle exec fastlane action run_tests

Key	Description
device	The name of the simulator type you want to run tests on (e.g. 'iPhone 6' or 'iPhone SE (2nd generation) (14.5)')
devices	Array of devices to run the tests on (e.g. ['iPhone 6', 'iPad Air', 'iPhone SE (2nd generation) (14.5)'])
skip_detect_devices	Should skip auto detecting of devices if none were specified
ensure_devices_found	Should fail if devices not found
force_quit_simulator	Enabling this option will automatically killall Simulator processes before the run
reset_simulator	Enabling this option will automatically erase the simulator before running the application
prelaunch_simulator	Enabling this option will launch the first simulator prior to calling any xcodebuild command
max_concurrent_simulators	Constrain the number of simulator devices on which to test concurrently. Equivalent to -maximum-concurrent-test-simulator-destinations
deployment_target_version	Target version of the app being build or tested. Used to filter out simulator version

[philprime]

We might also be able use destination directly:

https://github.com/fastlane/fastlane/blob/95cab31c184e3b0fd0ccebce9dd8ade5f224db1d/scan/lib/scan/detect_values.rb#L270-L282

https://github.com/fastlane/fastlane/blob/95cab31c184e3b0fd0ccebce9dd8ade5f224db1d/scan/lib/scan/options.rb#L477C44-L482

[philprime]

We decided to merge #5093 to remove the unnecessary ci-boot-simulator.sh as fastlane is not using it anyways.

We want to add the wait for boot script back in and change fastlane to use the manually booted simulator by defining the destination parameter.

Furthermore we should add the insights to the develop docs so React Native and Flutter can use it as a reference too.