Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Kafka integration #983

Open
wants to merge 28 commits into
base: main
Choose a base branch
from
Open

Kafka integration #983

wants to merge 28 commits into from

Commits on Oct 21, 2024

  1. Add kafka dependency and setup basic demo

    @TomBebb
    TomBebb committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    7a658de View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2024

  1. Implement basic env var reading / message reading

    @TomBebb
    TomBebb committed Nov 2, 2024
    Configuration menu
    Copy the full SHA
    dcd496b View commit details
    Browse the repository at this point in the history

  2. Support client_id override

    @TomBebb
    TomBebb committed Nov 2, 2024
    Configuration menu
    Copy the full SHA
    fb94dca View commit details
    Browse the repository at this point in the history

  3. Support int envs to builder mapping

    @TomBebb
    TomBebb committed Nov 2, 2024
    Configuration menu
    Copy the full SHA
    8f1bf00 View commit details
    Browse the repository at this point in the history

  4. Support durations

    @TomBebb
    TomBebb committed Nov 2, 2024
    Configuration menu
    Copy the full SHA
    11b8d7d View commit details
    Browse the repository at this point in the history

  5. Handle env parsing error better

    @TomBebb
    TomBebb committed Nov 2, 2024
    Configuration menu
    Copy the full SHA
    7162580 View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2024

  1. Show formatted errors on environment variable parsing error

    @TomBebb
    TomBebb committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    ce8d727 View commit details
    Browse the repository at this point in the history

  2. Sync kafka messages

    @TomBebb
    TomBebb committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    1d0905e View commit details
    Browse the repository at this point in the history

  3. Tidy imports

    @TomBebb
    TomBebb committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    d708659 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2024

  1. Fix double-import

    @TomBebb
    TomBebb committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    2317da9 View commit details
    Browse the repository at this point in the history

  2. Fix metadata error typo

    @TomBebb
    TomBebb committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    3d2f3b1 View commit details
    Browse the repository at this point in the history

  3. Add RustRover IDE folder to gitignore

    @TomBebb
    TomBebb committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    f68b7b1 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into kafka-integration 

    # Conflicts:
#	Cargo.toml
    @TomBebb
    TomBebb committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    4648715 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into kafka-integration

    @TomBebb
    TomBebb committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    28e316a View commit details
    Browse the repository at this point in the history

  6. Simplify log push

    @TomBebb
    TomBebb committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    4299c49 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2024

  1. Fix kafka order

    @TomBebb
    TomBebb committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    8c4dbae View commit details
    Browse the repository at this point in the history

  2. Improve kafka order

    @TomBebb
    TomBebb committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    ed685c6 View commit details
    Browse the repository at this point in the history

  3. Support kafka group/partition envs

    @TomBebb
    TomBebb committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    27c3f0b View commit details
    Browse the repository at this point in the history

  4. Simplify parseinterror prefix

    @TomBebb
    TomBebb committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    90a74cc View commit details
    Browse the repository at this point in the history

  5. Support fetch_crc_validation

    @TomBebb
    TomBebb committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    229bde8 View commit details
    Browse the repository at this point in the history

  6. Support kafka offset storage

    @TomBebb
    TomBebb committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    fc86edc View commit details
    Browse the repository at this point in the history

  7. Support kafka security

    @TomBebb
    TomBebb committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    1eb536f View commit details
    Browse the repository at this point in the history

  8. Support kafka fallback offset

    @TomBebb
    TomBebb committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    17bdb25 View commit details
    Browse the repository at this point in the history

  9. Fix security default value

    @TomBebb
    TomBebb committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    0ffc027 View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2024

  1. Merge branch 'main' into kafka-integration

    @TomBebb
    TomBebb authored Nov 10, 2024
    Configuration menu
    Copy the full SHA
    e2c04eb View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2024

  1. Merge branch 'main' into kafka-integration

    @TomBebb
    TomBebb authored Nov 11, 2024
    Configuration menu
    Copy the full SHA
    65e38ad View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2024

  1. Use rdkafka instead of kafka lib

    @TomBebb
    TomBebb committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    0d518a2 View commit details
    Browse the repository at this point in the history

  2. Use async message ingestion

    @TomBebb
    TomBebb committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    b94a933 View commit details
    Browse the repository at this point in the history