Data packaging
The Gamgem dataset is delivered as structured files that contain the gambling platform and payment destination entities described in the data models specification.
The dataset is incrementally versioned, with each version containing two complementary files: a complete snapshot and a delta file showing changes from the previous version.
Snapshots and deltas
Gamgem provides data through two complementary file types that serve different integration needs:
Complete dataset state
Snapshot files contain the current state of all gambling platforms and their payment destinations at a specific point in time. These files include every active entity in the dataset.
Use snapshots for:
- Initial data loads when implementing Gamgem
- Full system refreshes or rebuilds
- Recovering from data synchronization issues
- Periodic dataset validation
Snapshot files provide a reliable baseline for your implementation, ensuring you have the picture of all known payment destinations.
Complete dataset state
Snapshot files contain the current state of all gambling platforms and their payment destinations at a specific point in time. These files include every active entity in the dataset.
Use snapshots for:
- Initial data loads when implementing Gamgem
- Full system refreshes or rebuilds
- Recovering from data synchronization issues
- Periodic dataset validation
Snapshot files provide a reliable baseline for your implementation, ensuring you have the picture of all known payment destinations.
Incremental changes only
Delta files contain only the changes that occurred between two dataset versions. This includes newly identified platforms, updated payment details, and obsoleted entries.
Use deltas for:
- Regular incremental updates to maintain current data
- Reduced bandwidth usage for frequent updates
- Real-time synchronization with threat intelligence
- Maintaining change history and audit trails
Delta files are much smaller than snapshots, making them ideal for automated updates to your systems.
Snapshot file structure
Snapshot files use JSON Lines format (.jsonl
), where each line contains a JSON object representing a single entity. This format enables streaming processing and supports mixed entity types within the same file.
Dataset versions follow the pattern YYYYMMDDHHMMSS
(timestamp format), and snapshot files are named accordingly:
Snapshot file example
Each line is a valid JSON object.
Delta file structure
Delta files track changes between dataset versions, enabling incremental updates. Like snapshots, they use JSON Lines format but with a structure focused on change events.
File format
Each line represents a single change event with the following structure:
Type of change: ADD
, UPDATE
, or OBSOLETE
ISO 8601 timestamp when the change was recorded
Entity state after the change, using the same structure as snapshot entries
Change types
Delta file example
Here’s an example delta file showing various change types:
Entry ordering
Both file types guarantee specific ordering to enable sequential line-by-line processing:
- Platform entities first: All
PLATFORM
entities appear before any payment destination entities - Payment destinations second:
MERCHANT
,BANK_ACCOUNT
, andCRYPTO_WALLET
entities follow, in any order
- Platform entities first: All
PLATFORM
entities appear before any payment destination entities - Payment destinations second:
MERCHANT
,BANK_ACCOUNT
, andCRYPTO_WALLET
entities follow, in any order
- Chronological order: All changes are ordered by
occurredDate
(earliest first) - Same timestamp handling: When multiple changes have identical timestamps, Platform changes are ordered before payment destination changes
You can process each line immediately without needing to look ahead or buffer entities, as all dependencies are resolved by the guaranteed ordering.