Skip to content

Change accumulator releated signatures #216

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

pzhan9
Copy link
Contributor

@pzhan9 pzhan9 commented Jun 10, 2025

Differential Revision: D76357417

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Jun 10, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D76357417

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D76357417

pzhan9 added a commit to pzhan9/monarch-1 that referenced this pull request Jun 13, 2025
Summary:
Pull Request resolved: pytorch-labs#216

This diff is a prep diff for D76156297. Specifically, it does the following:

1. Add a `struct ReducerSpec` to replace the `64` reducer typehash. The main purpose of this struct is to add a new `builder_params` field, so we can argument the accumulator, with it, serialize it, and then send to comm actor, so comm actor can instantiate the reducer with this info.
2. Make some methods in `trait Accumulator` and `trait CommReducer` fallible. This is required by the python accumulator, because it does pickling and thus fallible.
3. Add a `typehash_f` field to `ReducerFactory`, which can be used to calculate the typehash directly.

Differential Revision: D76357417
@pzhan9 pzhan9 force-pushed the export-D76357417 branch from 020b5f5 to 8797cb1 Compare June 13, 2025 16:34
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D76357417

pzhan9 added a commit to pzhan9/monarch-1 that referenced this pull request Jun 16, 2025
Summary:
Pull Request resolved: pytorch-labs#216

This diff is a prep diff for D76156297. Specifically, it does the following:

1. Add a `struct ReducerSpec` to replace the `64` reducer typehash. The main purpose of this struct is to add a new `builder_params` field, so we can argument the accumulator, with it, serialize it, and then send to comm actor, so comm actor can instantiate the reducer with this info.
2. Make some methods in `trait Accumulator` and `trait CommReducer` fallible. This is required by the python accumulator, because it does pickling and thus fallible.
3. Add a `typehash_f` field to `ReducerFactory`, which can be used to calculate the typehash directly.

Reviewed By: mariusae

Differential Revision: D76357417
@pzhan9 pzhan9 force-pushed the export-D76357417 branch from 8797cb1 to 950b1f1 Compare June 16, 2025 13:46
pzhan9 and others added 3 commits June 17, 2025 12:09
…h-labs#260)

Summary:
Pull Request resolved: pytorch-labs#260

This diff exposes `PortRef` and `OncePortRef` to the python side, and use them where it can instead of `PortId`. This change makes it easier to implement `open_accum_port` on the python side, since we need to pass the reducer related info over from `PortRef`.

Another benefit from this diff is now we can differentiate whether the response port in `PythonMessage` is `OncePortRef` or not, and implement the Bind/Unbind accordingly.

Differential Revision: D76565833
Differential Revision: D76305562
Summary:
Pull Request resolved: pytorch-labs#216

This diff is a prep diff for D76156297. Specifically, it does the following:

1. Add a `struct ReducerSpec` to replace the `64` reducer typehash. The main purpose of this struct is to add a new `builder_params` field, so we can argument the accumulator, with it, serialize it, and then send to comm actor, so comm actor can instantiate the reducer with this info.
2. Make some methods in `trait Accumulator` and `trait CommReducer` fallible. This is required by the python accumulator, because it does pickling and thus fallible.
3. Add a `typehash_f` field to `ReducerFactory`, which can be used to calculate the typehash directly.

Reviewed By: mariusae

Differential Revision: D76357417
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D76357417

@pzhan9 pzhan9 force-pushed the export-D76357417 branch from 950b1f1 to 0f8af9e Compare June 18, 2025 01:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Meta Open Source bot. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants