Skip to content

Describe non-Iceberg tables - #203

Merged
YanivZalach merged 7 commits into
masterfrom
feat/info_when_not_iceberg
Oct 7, 2026
Merged

YanivZalach merged 7 commits into
masterfrom
feat/info_when_not_iceberg

Conversation

@YanivZalach

@YanivZalach YanivZalach commented Oct 6, 2026 •

Copy link
Copy Markdown
Owner

Summary

Add a table description endpoint and icegraph describe CLI command so users can inspect Spark-resolvable tables, including non-Iceberg tables. Show Spark schema, partitions, properties, and formatted table details when IceGraph cannot analyze a table. Identify unreachable Iceberg metadata files with a specific error and display a dedicated page. Update the docs, schema presentation, and MSW handlers to support these flows.

- Add a table description API and CLI command
- Show Spark schema, partitions, properties, and metadata for non-Iceberg tables
- Report unreachable Iceberg metadata files with a specific error
@YanivZalach
YanivZalach requested a review from Razberrry as a code owner October 6, 2026 11:28
- Rename the CLI command to `sparkdesc` and update its docs
- Pass table names to the description endpoint as query parameters
- Return Spark analysis errors as plain messages
Comment thread backend/constants.py Outdated
Comment thread backend/main.py Outdated
Comment thread backend/main.py Outdated
Comment thread icegraph-client/README.md Outdated
Comment thread frontend/src/mocks/handlers.js
Comment thread frontend/src/features/docs/content/loading-table.mdx
- Add format-version warnings to metadata and inventory responses
- Display warnings in the latest metadata view
- Document the warning in the UI, CLI, and IceGraph skill
- Fetch only the Provider row when checking table format
- Build mock table descriptions from Iceberg metadata
- Replace the tuple result from `_collect_describe` with `DescribeFormattedResult`
- Document the dataclass convention in `AGENTS.md`
@YanivZalach
YanivZalach merged commit 6e95db3 into master Oct 7, 2026
4 checks passed
@YanivZalach
YanivZalach deleted the feat/info_when_not_iceberg branch October 7, 2026 10:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant