测试通过 Xcode 但在 Circle CI 上失败

Question

问题：对于this pull request，测试没有通过CircleCI，但测试在本地通过。为什么？

CircleCI test output 显示所有 FBSnapshotTestCase 测试均失败。例如：

✗ testAdjustsFontSizeToFitWidth, ((comparisonSuccess__) is true) failed - Snapshot comparison failed: Error Domain=FBSnapshotTestControllerErrorDomain Code=1 "Unable to load reference image." UserInfo=0x7f85f36b0a50 {NSLocalizedFailureReason=Reference image not found. You need to run the test in record mode, NSLocalizedDescription=Unable to load reference image., FBReferenceImageFilePathKey=/Users/distiller/TTTAttributedLabel/Example/TTTAttributedLabelTests/ReferenceImages_32/TTTAttributedLabelTests/testAdjustsFontSizeToFitWidth@2x.png}

[…]

✗ testAttributedTruncationToken, ((comparisonSuccess__) is true) failed - Snapshot comparison failed: Error Domain=FBSnapshotTestControllerErrorDomain Code=1 "Unable to load reference image." UserInfo=0x7f85f35b06d0 {NSLocalizedFailureReason=Reference image not found. You need to run the test in record mode, NSLocalizedDescription=Unable to load reference image., FBReferenceImageFilePathKey=/Users/distiller/TTTAttributedLabel/Example/TTTAttributedLabelTests/ReferenceImages_32/TTTAttributedLabelTests/testAttributedTruncationToken@2x.png}

但是，相同的测试在本地通过：

在 CircleCI 上，测试使用 ReferenceImages_32 目录，该目录不存在：

/Users/distiller/TTTAttributedLabel/Example/TTTAttributedLabelTests/ReferenceImages_32/TTTAttributedLabelTests/testAdjustsFontSizeToFitWidth@2x.png

但是，图像确实存在于 ReferenceImages_64 中。我希望使用 _64 目录，因为 circle.yml 文件指定使用 iPhone 6 模拟器：

dependencies:
  pre:
    - xcrun instruments -w "iPhone 6 (8.3 Simulator)" || exit 0
  override:    
    - sudo gem install cocoapods xcpretty obcd -N
    - pod install --project-directory=Example
test:
  override:
    - set -o pipefail && xcodebuild -workspace 'Example/Espressos.xcworkspace' -scheme 'Espressos'
      -sdk iphonesimulator -destination "platform=iOS Simulator,name=iPhone 6"
      GCC_INSTRUMENT_PROGRAM_FLOW_ARCS=YES GCC_GENERATE_TEST_COVERAGE_FILES=YES clean test | xcpretty -c
      --report junit --output ${CIRCLE_TEST_REPORTS}/junit.xml

这是什么原因造成的？
如何让 CircleCI 的测试通过？
可能相关：this FBSnapshotTestCase issue

Answer 1

您是否尝试过运行没有缓存的构建？这经常为我解决这些问题。要在没有缓存的情况下构建，只需单击右上角的按钮。

测试通过 Xcode 但在 Circle CI 上失败

Tests pass in Xcode but fail on Circle CI

continuous-integration

ios

circleci

fbsnapshottestcase