Cloud Storage Uploads
Securely upload videos from AWS, GCP, or Azure using direct cloud integration or signed URLs.
Uploading From Cloud Storage
There are three primary ways to provide video files to NomadicML:
- Public URLs or Local Files: The simplest method for getting started. See the Quickstart guide for examples.
- Direct Cloud Integration: Grant our backend read-only access to your cloud storage bucket. This is the recommended approach for automated, continuous data ingestion.
- Signed URLs: Generate temporary, secure URLs for individual private files. This is ideal for one-off uploads from a secure environment.
This page covers the two cloud-native methods in detail below.
Direct Cloud Integration
To avoid exchanging keys, we offer direct integration with your cloud storage. This approach is ideal for continuous data ingestion pipelines. We support secure, read-only access for the following providers:
Cloud Provider | Integration Method | Details |
---|---|---|
AWS S3 | Bucket Policy | Grant our IAM role (arn:aws:iam::xxxx:role/xxxx-readonly-role ) read-only access to your S3 bucket |
Google Cloud Storage | IAM Policy | Grant the Storage Object Viewer role to our service account (xxxx@our.iam.gserviceaccount.com ) on your GCS bucket. |
Azure Blob Storage | Role Assignment | Please contact us to get the correct Service Principal for role assignment. |
This method avoids exchanging secret keys and gives you full control to manage access from your cloud console. Please contact our support team to configure a direct integration.
Signed URLs
If your videos are stored privately in Amazon S3 or Google Cloud Storage, you can provide NomadicML with a pre-signed URL. The SDK will download the file directly.
AWS S3 Example
Google Cloud Storage Example
Azure Blob Storage Example
In Azure, you can generate a Shared Access Signature (SAS) token to create a temporary, secure URL.
Use upload_and_analyze_videos
if you have many URLs. See SDK Usage Examples for full workflows.
Next Steps
After configuring your cloud storage, you can explore these topics: