mirror of
https://github.com/dtomlinson91/street_group_tech_test
synced 2025-12-22 11:55:45 +00:00
adding documentation
This commit is contained in:
7
notes/documentation/answers.md
Normal file
7
notes/documentation/answers.md
Normal file
@@ -0,0 +1,7 @@
|
||||
# Answers
|
||||
|
||||
## CSV
|
||||
|
||||
Read a csv file into Beam:
|
||||
|
||||
<https://stackoverflow.com/a/41171867>
|
||||
12
notes/documentation/beam_docs.md
Normal file
12
notes/documentation/beam_docs.md
Normal file
@@ -0,0 +1,12 @@
|
||||
# Beam Documentation
|
||||
|
||||
## Transforms
|
||||
|
||||
FlatMap:
|
||||
|
||||
<https://beam.apache.org/documentation/transforms/python/elementwise/flatmap/>
|
||||
|
||||
|
||||
I/O Transforms:
|
||||
|
||||
<https://beam.apache.org/documentation/io/built-in/>
|
||||
@@ -2,10 +2,4 @@
|
||||
|
||||
## Data
|
||||
|
||||
Full dataset:
|
||||
|
||||
`wget 0 http://prod.publicdata.landregistry.gov.uk.s3-website-eu-west-1.amazonaws.com/pp-complete.csv`
|
||||
|
||||
Current month:
|
||||
|
||||
`wget 0 http://prod.publicdata.landregistry.gov.uk.s3-website-eu-west-1.amazonaws.com/pp-monthly-update-new-version.csv`
|
||||
https://www.gov.uk/government/statistical-data-sets/price-paid-data-downloads
|
||||
|
||||
Reference in New Issue
Block a user