Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 90.902%. Comparing base (fce741e) to head (dfae33a).
Report is 1 commits behind head on main.

@@              Coverage Diff              @@
##              main     #4542       +/-   ##
=============================================
+ Coverage   90.882%   90.902%   +0.019%     
=============================================
  Files          617       617               
  Lines        71032     71053       +21     
  Branches     25332     25949      +617     
=============================================
+ Hits         64556     64589       +33     
+ Misses        6384      6367       -17     
- Partials        92        97        +5     

I believe we should not bump the version from iOS 17 to iOS 18, but instead keep test both versions due to changes in FileIO (#4546).

In addition I would propose we also add macOS 15 unit tests to this PR.

I just noticed the same applies for tvOS 17.5 and 18.1

@philipphofmann @armcknight I propose we use this PR to test compatibility with iOS 18, macOS 15 and tvOS 18 by updating the branch to main and merge the PR as soon as all checks pass. When we notice something is broken, like file I/O tracking in #4546, we fix it in other PRs instead. This should lead to multiple commits with clearer intentions.

We know that file IO instrumentation is broken. I would skip the failing tests for file IO instrumentation on iOS 18, merge this PR, so we run all other tests on iOS 18, and then enable the tests again once we fix the file IO instrumentation. It could also be that the file IO instrumentation won't work anymore on iOS 18, so we can't enable the failing tests anymore.

As I am about to finish fixing FileIO in #4605, there might not be much of a point in disabling and then re-enabling it, except for having CI running on the introduced OS versions too.

But there is actually another test failing with the newer OS versions, we need to look into/disable:

Failing tests:
	-[SentryFileIOTrackingIntegrationObjCTests test_NSFileManagerCreateFile]
	-[SentryFileIOTrackingIntegrationObjCTests test_NSFileManagerCreateFile]
	-[SentryFileIOTrackingIntegrationObjCTests test_NSFileManagerCreateFile]
	-[SentryFileIOTrackingIntegrationObjCTests test_NSFileManagerCreateFile]
	-[SentryFileIOTrackingIntegrationObjCTests test_NSFileManagerCreateFile]
	SentryFileIOTrackingIntegrationTests.test_ReadingURL_Tracking()
	SentryFileIOTrackingIntegrationTests.test_ReadingURLWithOption_Tracking()
	SentryFileIOTrackingIntegrationTests.test_Writing_Tracking()
	SentryFileIOTrackingIntegrationTests.test_WritingWithOption_Tracking()

	SentryStacktraceBuilderTests.testFramesOrder() <---

It's also fine to disable all failing tests for now and create follow-up issues. Most tests running on iOS 18 is long overdue.

The broken tests are now skipped, so I believe this can be merged.