Step-by-step queries for the questions the Catalog and the audit log answer. Start with Find files; use Capacity reports, Snapshots and change detection, and Tags and metadata for the Catalog, and Query the audit log for operations.
- Find files: Find files by path, type, age, size, owner and extension, with filters pushed down to the cluster instead of walking directories.
- Capacity reports: Report capacity by owner, file extension and directory from the Catalog with the Python SDK, and process large subtrees in record batches.
- Snapshots and change detection: List and read Catalog snapshots, and compare two of them to find files deleted, added or moved between them.
- Tags and metadata: Find objects by S3 tags and user metadata with the user_tags and user_metadata columns or with user-defined Catalog columns.
- Query the audit log: Use the Python SDK to see recent operations, who accessed a bucket and which requests failed, from the audit log table.