Skip to content

Create a row partitioner #16

New issue
New issue
Open
Open
Create a row partitioner#16

Description

@xweichu
xweichu
opened on Jun 19, 2020

Create a row partitioner which partitions the Arrow based on rows. Make each subpartition close to 10MB.

Activity

  1. xweichu commented on Jun 23, 2020

    @xweichu
    xweichu
    on Jun 23, 2020
    CollaboratorAuthor

    Here is an example of the partitioner:
    https://github.com/uccross/skyhookdm-pythonclient/blob/master/client/skyhookdmclient/skyhook.py#L77 , the partitioner function should be extracted.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions