Is your feature request related to a problem or challenge? Please describe what you are trying to do.
I perform various operations on dataframes but find I have to jump through hoops if I want to extract individual items.
Describe the solution you'd like
I'm not particular on the exact api but looking for something
>>> type(df.column("uuid"))
pa.ChunkedArray # or something workable
Describe alternatives you've considered
A few candidate examples
df.select('uuid').distinct().collect()[0][0]
df.to_arrow_table()["uuid"] # just jump out of dataframe early but has penalty of collecting things I don't need
My issue with collect is that is a series of record batches which is cumbersome to manage.
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
I perform various operations on dataframes but find I have to jump through hoops if I want to extract individual items.
Describe the solution you'd like
I'm not particular on the exact api but looking for something
Describe alternatives you've considered
A few candidate examples
df.select('uuid').distinct().collect()[0][0]df.to_arrow_table()["uuid"]# just jump out of dataframe early but has penalty of collecting things I don't needMy issue with collect is that is a series of record batches which is cumbersome to manage.