menu

weld

Using and developing Weld, a runtime for data analytics

Channels
Team

So many questions.

January 7, 2021 at 7:36am

So many questions.

January 7, 2021 at 7:36am
When I checked the benchmark tests of the project, I found that none of these tests seemed to be available. I don't know if you can use it. After modifying some parts, I found that under the Crime_Index test case, the performance did not improve but decreased. It seems that you also know it. I don't know what this means. Among the other examples, the data_cleaning example is improved. I am very interested in the tests of tpch_q1 and tpch_q6, but they seem to not run. I modified the program. But when it runs to weld, an error still occurs. Do you have any suggestions?

January 7, 2021 at 7:37am
at the very beginning:
  • reply
  • like
  • reply
  • like
after modification:
  • reply
  • like
Hmm, many of these benchmarks may be based on an older (slower, but multithreaded) release of Weld. This was the version that was used in all the published papers etc. If the Weld program doesn't compile, I would suggest updating it to work with the new syntax in 0.3.0, since the overall performance there is much better. Otherwise, you can try checking out the branch for the 0.2.0 release and testing with that.
  • reply
  • like