ae3bcd7eea
* Set up full test suite in CI and Xcode Cloud Add build-ghosttykit.yml workflow to pre-build and publish GhosttyKit.xcframework as a GitHub release on manaflow-ai/ghostty, keyed by submodule SHA. Add ci_scripts/ci_post_clone.sh for Xcode Cloud to download the pre-built xcframework with retry logic. Create cmux-ci scheme that runs both cmuxTests and cmuxUITests. Switch the CI tests job from running a single UI test class to the full suite. * Run unit tests + single UI test class on self-hosted runner The self-hosted runner can't launch the full app for UI tests (no GUI session), so run all unit tests via cmux-unit scheme and keep the original UpdatePillUITests as a smoke test. Full UI test suite runs on Xcode Cloud which has proper macOS GUI support. * Handle expected test failures in unit tests step xcodebuild returns exit code 65 even for expected failures (XCTExpectFailure). Parse the summary line to only fail the CI job when there are unexpected failures.
29 lines
1 KiB
Bash
Executable file
29 lines
1 KiB
Bash
Executable file
#!/usr/bin/env bash
|
|
# Regression test for https://github.com/manaflow-ai/cmux/issues/385.
|
|
# Ensures self-hosted UI tests are never run for fork pull requests.
|
|
set -euo pipefail
|
|
|
|
ROOT_DIR="$(cd "$(dirname "$0")/.." && pwd)"
|
|
WORKFLOW_FILE="$ROOT_DIR/.github/workflows/ci.yml"
|
|
|
|
EXPECTED_IF="if: github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository"
|
|
|
|
if ! grep -Fq "$EXPECTED_IF" "$WORKFLOW_FILE"; then
|
|
echo "FAIL: Missing fork pull_request guard for ui-tests in $WORKFLOW_FILE"
|
|
echo "Expected line:"
|
|
echo " $EXPECTED_IF"
|
|
exit 1
|
|
fi
|
|
|
|
if ! awk '
|
|
/^ tests:/ { in_tests=1; next }
|
|
in_tests && /^ [^[:space:]]/ { in_tests=0 }
|
|
in_tests && /runs-on: self-hosted/ { saw_self_hosted=1 }
|
|
in_tests && /github.event.pull_request.head.repo.full_name == github.repository/ { saw_guard=1 }
|
|
END { exit !(saw_self_hosted && saw_guard) }
|
|
' "$WORKFLOW_FILE"; then
|
|
echo "FAIL: tests block must keep both self-hosted and fork guard"
|
|
exit 1
|
|
fi
|
|
|
|
echo "PASS: tests self-hosted fork guard is present"
|