June 12, 2022, 6:47 p.m. | /u/tarsiospettro

Data Science www.reddit.com

I am creating a IoT data pipeline, where 100-300 machines save three times a day some .CSV files in a FTP server.

Each machine has a reserved access to a different folder, and the files contain time series records.

I need to make some filtering on the collected data and store them in an InfluxDB.

I know python, and my first idea Is to create a script to download files, open CSV with pandas filter the data and store in …

dataflow datascience python

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Field Sample Specialist (Air Sampling) - Eurofins Environment Testing – Pueblo, CO

@ Eurofins | Pueblo, CO, United States

Camera Perception Engineer

@ Meta | Sunnyvale, CA