Adding job labels for FinOps

[JulianUmbhau]

Added labels to job creation calls for FinOps purposes
Labels can be set globally via:
options(bigrquery.labels = list(env = "prod", team = "analytics"))
Labels are then automatically attached to all BigQuery job requests (query, load, extract, copy).

• Added check_labels() to validate labels against BigQuery's key/value constraints before sending
• Added bigrquery.labels default option (NULL) in .onLoad()
• Added tests for check_labels()
• Fixed pre-existing inconsistency: auto_unbox = TRUE was already present in bq_post/bq_patch but was missing from the toJSON calls in bq_perform_upload and bq_parse_single

Fixes #652

[hadley]

Would you mind pointing me to the BigQuery docs for labels?

In the interest of using the simplest possible data structure, is there a reason to use a list instead of a named character vector?

[JulianUmbhau]

Would you mind pointing me to the BigQuery docs for labels?

In the interest of using the simplest possible data structure, is there a reason to use a list instead of a named character vector?

Here are the docs: https://docs.cloud.google.com/bigquery/docs

And you are correct, the list was unnecessary. I have changed that to a named chr vector.

[schifferl]

Adding my support for this feature – it is important for cost allocation in production applications that use R to communicate with BigQuery.

[hadley]

Thanks for working on this! A few comments on the overall approach and implementation below.

I assume you have tested this interactively?

[JulianUmbhau]

Thanks for working on this! A few comments on the overall approach and implementation below.

I assume you have tested this interactively?

Ofc, thank you the comments!

We use this every day, but I have now tested it more thoroughly.

I had to change the character vector back to list - i hadn't tested that change well enough.
The jsonlite::toJSON function drops the names of the character vector and changes it to an array. And the auto_unbox = TRUE is needed to ensure the value is not wrapped in an array.

[hadley]

@JulianUmbhau could you please double check that my changes haven't broken anything for you?

[hadley]

@JulianUmbhau I'm going to release early next week so I'd really appreciate a look if you have the time 😄