Migrate a large dataset into a database — in batches

The scenario loads a large dataset in batches: it requests rows, cleans them, adds tags and stores them in the database on a loop until the data runs out.

  • Data moves in batches — memory never overflows
  • Every record is cleaned and tagged
  • Handles even very large datasets
  • The migration runs itself, no manual babysitting