Gamgem provides dataset access through an HTTPS API that delivers temporary download links to dataset files. This approach combines authenticated API access with direct file downloads from our content delivery network.

HTTPS API with direct downloads

The distribution method uses a two-step process: authenticate and get download links through our API, then download files directly using those links.

1

Discover versions

Call the versions API endpoint to see available dataset releases and their publication dates.

2

Get download links

Request temporary download URLs for a specific dataset version.

3

Download files

Use the provided URLs to download snapshot and delta files directly.

4

Process data

Parse the downloaded JSONL files according to the data packaging specifications.

Download URLs are pre-signed S3 links that expire after one hour.

Version discovery

List all available dataset versions:

GET /gems/gamgem/versions

Response
{
  "versions": [
    {
      "version": "20250307213304",
      "publishedDate": "2025-03-07T21:33:04Z"
    },
    {
      "version": "20250306213304", 
      "publishedDate": "2025-03-06T21:33:04Z"
    }
  ]
}

Request download URLs for a specific version:

GET /gems/gamgem/versions/{version}/files

Response
{
  "version": "20250306213304",
  "files": [
    {
      "type": "SNAPSHOT",
      "filename": "gamgem-snapshot-20250306213304.jsonl",
      "url": "https://paysway-production-gamgem.s3.eu-west-2.amazonaws.com/versions/20250306213304/gamgem-snapshot-20250306213304.jsonl?X-Amz-Algorithm=...",
      "expiresAt": "2025-03-06T22:33:04Z"
    },
    {
      "type": "DELTA", 
      "filename": "gamgem-delta-20250306213304.jsonl",
      "url": "https://paysway-production-gamgem.s3.eu-west-2.amazonaws.com/versions/20250306213304/gamgem-delta-20250306213304.jsonl?X-Amz-Algorithm=...",
      "expiresAt": "2025-03-06T22:33:04Z"
    }
  ]
}

Download files

Use the provided URLs to download files:

curl -o gamgem-snapshot-20250306213304.jsonl \
  "https://paysway-production-gamgem.s3.eu-west-2.amazonaws.com/versions/20250306213304/gamgem-snapshot-20250306213304.jsonl?X-Amz-Algorithm=..."

Release schedule

Dataset versions are published on an irregular schedule based on data collection activities. New versions become available when new gambling platforms or payment destinations have been identified and validated.

There is no fixed release schedule. We recommend checking for updates at least daily.

SFTP alternative

For organizations with specific compliance requirements or systems that require traditional file transfer protocols, SFTP access is available upon request.

SFTP provides:

  • SSH key-based authentication
  • Direct file system access to dataset files
  • Read-only access with audit logging

SFTP access requires additional setup and configuration. Contact us if you require SFTP delivery instead of the standard HTTPS API.