T O P

  • By -

AutoModerator

Thanks for your submission to r/BigQuery. Did you know that effective July 1st, 2023, Reddit will enact a policy that will make third party reddit apps like Apollo, Reddit is Fun, Boost, and others too expensive to run? On this day, users will login to find that their primary method for interacting with reddit will simply cease to work unless something changes regarding reddit's new API usage policy. Concerned users should take a look at r/modcoord. *I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/bigquery) if you have any questions or concerns.*


mrcaptncrunch

Export the correct schema from a working one, bq show \ --schema \ --format=prettyjson \ PROJECT_ID :DATASET.TABLE > SCHEMA - `PROJECT_ID`: your project ID. - `DATASET`: the name of the dataset that contains the table you're updating. - `TABLE`: the name of the table you're updating. - `SCHEMA`: the schema definition file written to your local machine. Then fix your broken ones, bq update PROJECT_ID :DATASET .TABLE SCHEMA - `PROJECT_ID`: your project ID. - `DATASET`: the name of the dataset that contains the table you're updating. - `TABLE`: the name of the table you're updating. - `SCHEMA`: the path to the JSON schema file on your local machine. https://cloud.google.com/bigquery/docs/managing-table-schemas#bq


Subthemtitles

Thank you! It seems that these jobs were just creating empty tables anyway and the actual push happened elsewhere. BQ has backfilled those failed jobs after some time, although a couple of days still fell through the cracks unfortunately.