Skip to content

fix: Cap modin object store memory on macOS - #195

Open
alexander-beedie wants to merge 1 commit into
pola-rs:mainfrom
alexander-beedie:macos-modin-memory
Open

alexander-beedie wants to merge 1 commit into
pola-rs:mainfrom
alexander-beedie:macos-modin-memory

Conversation

@alexander-beedie

Copy link
Copy Markdown
Contributor

We need to cap this on macOS to avoid the following error when larger values are set:

MODIN_MEMORY=8000000000 → ValueError: 
  The configured object store size (7.451GiB)
  exceeds the optimal size on Mac (2.0GiB) 

While we could also set RAY_ENABLE_MAC_LARGE_OBJECT_STORE=1, this isn't really recommended as performance degrades substantially...

(ref: ray._private.ray_constants.MAC_DEGRADED_PERF_MMAP_SIZE_LIMIT)

@alexander-beedie

alexander-beedie commented Sep 4, 2026

Copy link
Copy Markdown
Contributor Author

Would be nice to get #186 merged too, so macOS dev/bench goes smoothly :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant