Skip to content

Commit

Permalink
spark rollfun add missing window size
Browse files Browse the repository at this point in the history
  • Loading branch information
jangorecki authored Jul 24, 2023
1 parent 088e89b commit 0da07f9
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions spark/rollfun-spark.py
Original file line number Diff line number Diff line change
Expand Up @@ -46,6 +46,11 @@

x.createOrReplaceTempView("x")

# window size
w = int(x.count()/1e3)
wsmall = int(x.count()/1e4)
wbig = int(x.count()/1e2)

task_init = timeit.default_timer()
print("rolling...", flush=True)

Expand Down

0 comments on commit 0da07f9

Please sign in to comment.