mirror of
https://github.com/dtomlinson91/street_group_tech_test
synced 2025-12-22 11:55:45 +00:00
adding documentation
This commit is contained in:
7
notes/documentation/answers.md
Normal file
7
notes/documentation/answers.md
Normal file
@@ -0,0 +1,7 @@
|
|||||||
|
# Answers
|
||||||
|
|
||||||
|
## CSV
|
||||||
|
|
||||||
|
Read a csv file into Beam:
|
||||||
|
|
||||||
|
<https://stackoverflow.com/a/41171867>
|
||||||
12
notes/documentation/beam_docs.md
Normal file
12
notes/documentation/beam_docs.md
Normal file
@@ -0,0 +1,12 @@
|
|||||||
|
# Beam Documentation
|
||||||
|
|
||||||
|
## Transforms
|
||||||
|
|
||||||
|
FlatMap:
|
||||||
|
|
||||||
|
<https://beam.apache.org/documentation/transforms/python/elementwise/flatmap/>
|
||||||
|
|
||||||
|
|
||||||
|
I/O Transforms:
|
||||||
|
|
||||||
|
<https://beam.apache.org/documentation/io/built-in/>
|
||||||
@@ -2,10 +2,4 @@
|
|||||||
|
|
||||||
## Data
|
## Data
|
||||||
|
|
||||||
Full dataset:
|
https://www.gov.uk/government/statistical-data-sets/price-paid-data-downloads
|
||||||
|
|
||||||
`wget 0 http://prod.publicdata.landregistry.gov.uk.s3-website-eu-west-1.amazonaws.com/pp-complete.csv`
|
|
||||||
|
|
||||||
Current month:
|
|
||||||
|
|
||||||
`wget 0 http://prod.publicdata.landregistry.gov.uk.s3-website-eu-west-1.amazonaws.com/pp-monthly-update-new-version.csv`
|
|
||||||
|
|||||||
Reference in New Issue
Block a user