Release 0.3.5

This release includes:

• dsub
  • Fix RFC3339 date parsing errors with specific values under Python3
• google-v2 provider updates:
  • Filter out warning from google-auth.
  • Retry ResponseNotReady error.
  • Add zones for Zurich and Osaka.
  • Move "sleep before retry" messages from INFO in stdout to WARNING in stderr. This ensures that the retry messages bubble up to the stderr output recorded in the pipeline's operation.

Release 0.3.4

This release includes:

• dsub
  • Explicitly reject launching jobs if blank lines found in tasks file (instead of erroring)
• google-v2 provider updates:
  • Expose the Pipelines API operation id in dsub launch stderr output.
  • Replace oauth2lib with google-auth
  • Update cloud sdk image to a GCR hosted one, gcr.io/google.com/cloudsdktool/cloud-sdk:264.0.0-slim. This version was specifically chosen as the next version updates gsutil from 4.42 to 4.43. 4.43 includes undesired changes to gsutil cp. See gsutil's changelogs and the regression for details.
• Test updates:
  • Use fake time in retrying_test.

Release 0.3.3

This release includes:

• dsub
  • Fix cases where stderr was redirected to stdout instead of vice-versa.
• google-v2 provider updates:
  • Retry support for starting with preemptible and falling back to non-preemptible VMs
  • Add a delay between gsutil cp retries
• Documentation updates:
  • Remove note from README about experimental Python3 support.

Release 0.3.2

This release includes:

• dsub
  • Py3 compliance updates.
  • Fix UnicodeEncodeError when task error message contains non-ascii characters
  • Fix datetime.datetime.max construction used in wait loop to be an offset-aware datetime.
  • Silence retrying messages during the wait loop.
• google-v2 provider updates:
  • Fix failing final_logging actions.
  • Support stackdriver monitoring
• Documentation updates:
  • Made it clear that multiple --input, --output, --input-recursive, and --output-recursive parameters may be used.
  • Fix 'lookup' typo.

Release 0.3.1

Python 3 is now part of automated testing.
All unit and integration tests are now run with Python 2.7 and Python 3.7.

The google provider is no longer included in automated tests.

Specific changes in this release include:

• dstat
  • Separate recursive input/output from input/output fields..
  • Fix YAMLLoadWarning that was being emitted.
• dsub
  • Experimental: generate 32 character UUID job ids with --unique-job-ids flag.
• local provider updates:
  • Ensure runner-log.txt is written as text.
• google-v2 provider updates:
  • Add timestamps in .log files.
• Test updates:
  • Remove the google provider from automated tests.
  • Fix the way that the project ID is discovered for Python 3.
  • Increase concurrency and optionally disable Python module tests.

Release 0.3.0

This release includes one change:

• google-v2 is now the default provider.

Release v0.2.6

Note:
This is the last planned release with google as the default provider.
The new default provider will be google-v2.

This release includes:

• google-v2 provider updates:
  • --disk-type option added.
  • --service-account option added.
  • Fix dstat to find jobs submitted with user-ids containing non-alphanumeric non-hyphen characters.
  • Fix dstat to better handle operations with no actions.

Release v0.2.5

This release includes:

• dsub

  • When tasks are retried (based on use of the --retries flag), output messages are now more informative.
  • bash image can now be used with the local and google-v2 providers (updated Docker entrypoints to use /usr/bin/env bash instead of /bin/bash)
  • google-v2 provider updates:
    • --nvidia-driver-version parameter can now be used to specifiy the NVIDIA driver version to use when attaching an NVIDIA GPU accelerator.
    • log files are copied locally on the VM before upload to GCS. This avoids ResumableUploadAbortException copying large logs.

• dstat

  • script and script-name now appears in dstat --full output.
  • pyyaml version updated to latest version allowing Python3.7 support.

Release v0.2.4

This release includes:

• google-v2 provider:
  • --min-ram and --min-core parameters can now be used to automatically select one of the Compute Engine Custom Machine Types.
  • --mount a persistent disk created from a Compute Engine Image
  • Prefixes like "Execution failed: action <n>" removed from status messages in dstat.
• local provider:
  • --mount a local directory
• Add Hong Kong zones.

Release v0.2.3

This release includes:

• google:
  • A large deprecation WARNING will now be emitted when using the google provider.
• google-v2
  • Exit with error if logging fails.
  • Better messaging on failures.
  • Bug fixes for exception handling in ddel jobs
• local:
  • Better messaging on logging failures.