Skip to content

Various fixes for sgr cloud CLIs#602

Merged
mildbyte merged 6 commits intomasterfrom
bugfix/cli-csv-ingestion
Dec 30, 2021
Merged

Various fixes for sgr cloud CLIs#602
mildbyte merged 6 commits intomasterfrom
bugfix/cli-csv-ingestion

Conversation

@mildbyte
Copy link
Contributor

Things that cropped up during manual testing of the project seed workflow

When using `sgr csv import`, we load data using `COPY FROM STDIN` which doesn't
let us treat empty strings as NULLs, whereas with the CSV FDW we can do that.
To get around this, we use the empty strings in the type inference in the former
case (so that integer columns with empty strings still end up as VARCHARs).
Elaborate on needing to edit the `splitgraph.yml` file
It would ignore the list of repos to limit the load to; fix by filtering the
repos in any case.
  - use "ephemeral" instead of cte for materialization

The sample job in the suite at https://github.com/mildbyte/template-test-2/runs/4667663552?check_suite_focus=true
now actually completes (but doesn't do anything) because it just makes an unchecked
CTE (the source tables don't exist).

Fails as expected (https://github.com/mildbyte/template-test-2/runs/4667687824?check_suite_focus=true)
if we materialize as tables since then the relation indeed doesn't exist.
@mildbyte mildbyte merged commit ef4c785 into master Dec 30, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants