This repository was archived by the owner on Jun 14, 2024. It is now read-only.
Aggregated data into index #506
Answered
by
sezruby
ashokblend
asked this question in
Q&A
|
As i see hyperspace supports index creation only if query scans hdfs file. Is there plan to support for below kind of query. val df = spark.sql("select dim1,dim2,sum(measure1) as measure1 from table group by dim1,dim2") hs.createIndex(df, IndexConfig("dim1dim2", indexedColumns = Seq("dim1","dim2"), includedColumns = Seq("measure1"))) |
Answered by
sezruby
Oct 13, 2021
Replies: 1 comment
|
There is an issue related to the feature: #186 Since the spark plan of the query can be different depending on spark versions, it's somewhat difficult to support the feature. Though it's not a simple item/implementation and not planned yet. |
0 replies
Answer selected by
ashokblend
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
There is an issue related to the feature: #186
Since the spark plan of the query can be different depending on spark versions, it's somewhat difficult to support the feature.
Maybe we could try to implement it with a SQL string as a source, like
hs.createIndex(IndexConfig("name", "sql"))Though it's not a simple item/implementation and not planned yet.