6 Commits

Author	SHA1	Message	Date
Daniel Tomlinson	bb71d55f8c	adding latest beam pipeline code for dataflow	2021-09-26 16:23:19 +01:00
Daniel Tomlinson	8047b5ced4	adding latest beam pipeline code for dataflow	2021-09-26 16:16:58 +01:00
Daniel Tomlinson	9f53c66975	adding latest beam pipeline code for dataflow	2021-09-26 15:57:00 +01:00
Daniel Tomlinson	62bd0196ad	removing shard_name_template from output file	2021-09-26 06:11:42 +01:00
Daniel Tomlinson	7f9b7e4bfd	moving inputs/outputs to use pathlib	2021-09-26 06:03:55 +01:00
Daniel Tomlinson	9fdc6dce05	migrate beam pipeline to main.py	2021-09-26 01:10:09 +01:00