Skip to content

Add Dask kernel_computation support#39

Draft
MarcSkovMadsen wants to merge 56 commits intopanel-extensions:mainfrom
MarcSkovMadsen:enhancement/support-dask
Draft

Add Dask kernel_computation support#39
MarcSkovMadsen wants to merge 56 commits intopanel-extensions:mainfrom
MarcSkovMadsen:enhancement/support-dask

Conversation

@MarcSkovMadsen
Copy link
Copy Markdown
Collaborator

@MarcSkovMadsen MarcSkovMadsen commented Nov 10, 2024

Builds on #38. So review that one first.

@MarcSkovMadsen
Copy link
Copy Markdown
Collaborator Author

MarcSkovMadsen commented Nov 10, 2024

Currently it does not work. By studying pygwalker I can see their dataframe support comes registrating the dataframe in duckdb. For example for modin they first convert to pandas and the register :-). I don't think that is what we want to do with dask. We want to use its compute engine.

My hypothesis is that dask should be supported via dask-sql and a custom parser. Might require a little bit more work.

As dask is not what I need for my use cases, I will park it here for now. Hoping that others will take it up if they need it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant