promptdojo_promptdojo_promptdojo_promptdojo_promptdojo_promptdojo_promptdojo_promptdojo_promptdojo_promptdojo_promptdojo_

Mission: API-to-dataset pipeline — step 7 of 7

ch 37 · dataset formats, ingestion, and validation pipelinesch 37 · dataset formats, ingestion, and validation pipelinesch 37 · dataset formats, ingestion, and validation pipelinesch 37 · dataset formats, ingestion, and validation pipelinesch 37 · dataset formats, ingestion, and validation pipelinesch 37 · dataset formats, ingestion, and validation pipelinesch 37 · dataset formats, ingestion, and validation pipelinesch 37 · dataset formats, ingestion, and validation pipelinesch 37 · dataset formats, ingestion, and validation pipelinesch 37 · dataset formats, ingestion, and validation pipelinesch 37 · dataset formats, ingestion, and validation pipelines7/7
Checkpoint

One last thing before we move on. pass this to mark the lesson done, or skip and keep moving.

The mission, miniature: write ingest(start_page) that pages until empty, validates each record (float-parseable amt), upserts clean rows into the dataset dict keyed by id, and adds bad record ids to the quarantine SET. Run it twice (a full resume) and prove nothing duplicated: dataset=2, quarantine=1, pages=2, ids [1, 3].

full-screen editor opens — close anytime to keep reading.

open the editor to run it.