Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add transaction recoverability #43572

Closed
wants to merge 76 commits into from
Closed

Add transaction recoverability #43572

wants to merge 76 commits into from

Conversation

gimantha
Copy link
Contributor

Purpose

Describe the problems, issues, or needs driving this feature/fix and include links to related issues.

Partially fix #42031

Approach

Describe how you are implementing the solutions along with the design details.

Samples

Provide high-level details about the samples related to this feature.

Remarks

List any other known issues, related PRs, TODO items, or any other notes related to the PR.

Check List

  • Read the Contributing Guide
  • Updated Change Log
  • Checked Tooling Support (#)
  • Added necessary tests
    • Unit Tests
    • Spec Conformance Tests
    • Integration Tests
    • Ballerina By Example Tests
  • Increased Test Coverage
  • Added necessary documentation
    • API documentation
    • Module documentation in Module.md files
    • Ballerina By Examples

@dsplayerX
Implement recovery log file system
3106e32
@dsplayerX
Cleanup unused imports
630b4c5
@dsplayerX
Add initialization of fileRecoveryLog to TransactionResourceManager
9a56cdf
@dsplayerX
Add TransactionRecord to store a log record
1cb2ff8
@dsplayerX
Implement in memory log and rewrite some functions
d295306
@dsplayerX
Add enum for recovery statuses instead of string
a540ae5
@dsplayerX
Add recoveryLogName config to transaction.bal
f8a2b3f
@dsplayerX
Fix null pointer and concurrent modification exceptions with existing…
4b6dfdb 
…Logs
@dsplayerX
Updated comments
bb0df43
@dsplayerX
Add hazard state to RecoveryStatus
228fb0b
@dsplayerX
Implement checkpointing for file and in memory logs
8f8418d
@dsplayerX
Change default checkpoint interval
c11d3e4
@dsplayerX
Move parseTransactionLogRecord to TransactionLogRecord class
a51ee30
@dsplayerX
Add configs for log directory and deletion of old logs
38b0442
@dsplayerX
Add comments and cleanup code
36f1c79
@dsplayerX
Add force/lazy writing to logs
6f78138
@dsplayerX
Update recovery statuses
c49e433
@dsplayerX
Update Xid to gtrid and unique formatId
774c527
@dsplayerX
Add a placeholder bqual
af0dbe4
@dsplayerX
Implement recovery for xaResources
86a1e35
@dsplayerX
Refactor RecoveryStatus to RecoveryState
0d2fc9f
@dsplayerX
Update TransactionLogRecord to include log time
dab23b5
@dsplayerX
Update createXID to use trxId and blockId
86ae597
@dsplayerX
Update hazard state log record
30478f8
@dsplayerX
Handle exceptions in xaResourceRecovery
d8bcba2
@dsplayerX
Minor changes to logs
152d2ab
@dsplayerX
Implement the log manager
83fe1e2
@dsplayerX
Add getDefaultFormat in XIDGenerator
24b1c3f
@dsplayerX
Write terminated logs during transaction clean up
81a8c92
@dsplayerX
Update getCombinedId
23b10e6
dsplayerX and others added 24 commits March 11, 2024 10:21
@dsplayerX
Remove trailing whitespaces when parsing logs
c07cdaa
@dsplayerX
Add cannot parse log record runtime error
eb0775a
@dsplayerX
Make startup recovery symbol a constant
9807001
@dsplayerX
Add method to write multiple logs to file
f303138
@dsplayerX
Remove redundant file name check in findLatestVersion
6c02229
@dsplayerX
Add unit tests for recovery and log managers.
5ae4915 
- Introduced mockito as a dependency.
- Added unit tests for RecoveryManager and LogManager.
@dsplayerX
Add unit test for xid creation
ad065ed
@dsplayerX
Rename checkpoint interval key variable
4b73d66
@dsplayerX
Add method comments and fix typos
ab61d60
@dsplayerX
Add unit tests for heuristic termination
0d38a71
@dsplayerX
Make initAppendChannel thread safe
be64fab 
Previously, concurrent calls to createNextVersion() or put() could result in race conditions where multiple threads could attempt to initialize the appendChannel simultaneously. This was addressed by adding a double-checked locking mechanism to ensure that only one thread initializes the appendChannel when it's null.
@dsplayerX
Refactor createXid method
878cc73
@dsplayerX
Resolve merge conflicts
db1d550
@dsplayerX
Make getFailedTransaction method concurrent safe
d6a6919
@dsplayerX
Refactor handleHeuristicTermination method
8232e93
@dsplayerX
Refactor handling recovery in resources
927c6b5
@dsplayerX
Introduce FileLockAndChannel to handle append channel and locking
11ac5e8
@dsplayerX
Rework putAll method
45e30eb
@dsplayerX
Refactor transaction log managers to use singleton pattern
393d187
@gimantha
Resolve merge conflicts
5c63125
@gimantha
Merge branch 'master' of https://github.com/ballerina-platform/baller…
d202e3b 
…ina-lang into dsplayerX-feature-transaction-recovery
@dsplayerX
Merge pull request #2 from gimantha/dsplayerX-feature-transaction-rec…
224eea5 
…overy

Sync with master
@gimantha
Merge pull request #42080 from dsplayerX/feature-transaction-recovery
86ae40b 
Implement Transaction Recovery for XA Resources
@gimantha
Resolve merge conflicts
c9ee85f
@sonarcloud SonarCloud
Copy link

sonarcloud bot commented Nov 12, 2024

Quality Gate Failed Quality Gate failed

Failed conditions
0.0% Coverage on New Code (required ≥ 80%)
E Reliability Rating on New Code (required ≥ A)

See analysis details on SonarCloud

Catch issues before they fail your Quality Gate with our IDE extension SonarLint

@gimantha gimantha closed this Nov 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@sameerajayasoma sameerajayasoma Awaiting requested review from sameerajayasoma sameerajayasoma is a code owner

@hasithaa hasithaa Awaiting requested review from hasithaa hasithaa is a code owner

@MaryamZi MaryamZi Awaiting requested review from MaryamZi MaryamZi is a code owner

@warunalakshitha warunalakshitha Awaiting requested review from warunalakshitha warunalakshitha is a code owner

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[Task]: Extending Ballerina's Transaction Support to Include Transaction Recovery
2 participants
@gimantha @dsplayerX