keep DropOnSync alive until after dispatching for cuda slices#6673
Open
onursatici wants to merge 1 commit intodevelopfrom
Open
keep DropOnSync alive until after dispatching for cuda slices#6673onursatici wants to merge 1 commit intodevelopfrom
onursatici wants to merge 1 commit intodevelopfrom
Conversation
Signed-off-by: Onur Satici <onur@spiraldb.com>
Contributor
|
I thought the ones returned from |
Contributor
Author
|
yes they only record events, but those events are internal to the cuda view and they are used for synchronising other read or write operations on the same slice |
Contributor
|
So is there a practical thing to change here or is this something that is useful when combined with another change? |
Contributor
|
@onursatici I think this lgtm, but would love to review this tomorrow morning with a fresh mind. |
Contributor
Author
|
I believe we don't use the same cuda slice from multiple cuda streams yet so this won't fix anything yet, but it does future proof us for that world |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
cuda device pointers come with
SyncOnDropthat is used to synchronise reads and writes to the underlying cuda buffer. We should keep those alive until after dispatching the read or write work on them. For our single stream case this is fine, but if we were to have multiple streams accessing the same buffer these would be a problem