-
Notifications
You must be signed in to change notification settings - Fork 118
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
qps/rate limit & reduce expire seek range & expire-key hash #204
base: master
Are you sure you want to change the base?
Commits on Sep 3, 2019
-
fix empty command which cause titan to crash in parsing command
xufangping committedSep 3, 2019 Configuration menu - View commit details
-
Copy full SHA for db84a39 - Browse repository at this point
Copy the full SHA db84a39View commit details -
change empty command's reply error from ErrEmptyArray to ErrEmptyCommand
xufangping committedSep 3, 2019 Configuration menu - View commit details
-
Copy full SHA for 3e4b89e - Browse repository at this point
Copy the full SHA 3e4b89eView commit details -
close the connection when meet empty command
xufangping committedSep 3, 2019 Configuration menu - View commit details
-
Copy full SHA for c89b27f - Browse repository at this point
Copy the full SHA c89b27fView commit details
Commits on Sep 6, 2019
-
some illegal clients send unreadable command which may cause titan cr…
…ash. just after read the command we check if it is in command list we support, else will skip it
xufangping committedSep 6, 2019 Configuration menu - View commit details
-
Copy full SHA for 43bd6c3 - Browse repository at this point
Copy the full SHA 43bd6c3View commit details -
if a connection send unknown commands 3 times, close it
xufangping committedSep 6, 2019 Configuration menu - View commit details
-
Copy full SHA for 95bd04b - Browse repository at this point
Copy the full SHA 95bd04bView commit details
Commits on Sep 18, 2019
-
add expire left seconds metrics
xufangping committedSep 18, 2019 Configuration menu - View commit details
-
Copy full SHA for 63b131d - Browse repository at this point
Copy the full SHA 63b131dView commit details -
fix expire left time calculating
xufangping committedSep 18, 2019 Configuration menu - View commit details
-
Copy full SHA for a9c28fe - Browse repository at this point
Copy the full SHA a9c28feView commit details
Commits on Sep 19, 2019
-
when set left/delay current seconds(expire), also set other seconds to 0
xufangping committedSep 19, 2019 Configuration menu - View commit details
-
Copy full SHA for e5ff501 - Browse repository at this point
Copy the full SHA e5ff501View commit details
Commits on Oct 25, 2019
-
xufangping committed
Oct 25, 2019 Configuration menu - View commit details
-
Copy full SHA for fb11c67 - Browse repository at this point
Copy the full SHA fb11c67View commit details
Commits on Nov 7, 2019
-
xufangping committed
Nov 7, 2019 Configuration menu - View commit details
-
Copy full SHA for 586b30d - Browse repository at this point
Copy the full SHA 586b30dView commit details
Commits on Nov 21, 2019
-
1 use rate.limiter to implement limit and read tikv key/value to get …
…new limit 2 just balance limit base in active titan server num 3 unit test of rate limit passed
xufangping committedNov 21, 2019 Configuration menu - View commit details
-
Copy full SHA for 27f54e7 - Browse repository at this point
Copy the full SHA 27f54e7View commit details -
qps also can be set burst, its limit also support k/K/m/M suffix
xufangping committedNov 21, 2019 Configuration menu - View commit details
-
Copy full SHA for e5018e4 - Browse repository at this point
Copy the full SHA e5018e4View commit details -
Configuration menu - View commit details
-
Copy full SHA for ecd78a2 - Browse repository at this point
Copy the full SHA ecd78a2View commit details -
add limit default config items and fix error in config.go
xufangping committedNov 21, 2019 Configuration menu - View commit details
-
Copy full SHA for 0648ab8 - Browse repository at this point
Copy the full SHA 0648ab8View commit details -
in startSyncNewLimit, just read all match limit once for every comman…
…d's qps/rate
xufangping committedNov 21, 2019 Configuration menu - View commit details
-
Copy full SHA for f86245a - Browse repository at this point
Copy the full SHA f86245aView commit details
Commits on Nov 22, 2019
-
xufangping committed
Nov 22, 2019 Configuration menu - View commit details
-
Copy full SHA for 157d70a - Browse repository at this point
Copy the full SHA 157d70aView commit details -
add limit cleared log trace, just log limit is trigger when delay > 0
xufangping committedNov 22, 2019 Configuration menu - View commit details
-
Copy full SHA for fd0d8cc - Browse repository at this point
Copy the full SHA fd0d8ccView commit details -
change limit/commandFunc cost seconds factor from 2 to 1.4
xufangping committedNov 22, 2019 Configuration menu - View commit details
-
Copy full SHA for 756a0e6 - Browse repository at this point
Copy the full SHA 756a0e6View commit details -
fix titan active time decoding bug
xufangping committedNov 22, 2019 Configuration menu - View commit details
-
Copy full SHA for 46bb6da - Browse repository at this point
Copy the full SHA 46bb6daView commit details -
xufangping committed
Nov 22, 2019 Configuration menu - View commit details
-
Copy full SHA for a839995 - Browse repository at this point
Copy the full SHA a839995View commit details -
fix titan active time parsing bug
xufangping committedNov 22, 2019 Configuration menu - View commit details
-
Copy full SHA for 815efa4 - Browse repository at this point
Copy the full SHA 815efa4View commit details -
xufangping committed
Nov 22, 2019 Configuration menu - View commit details
-
Copy full SHA for 9612571 - Browse repository at this point
Copy the full SHA 9612571View commit details -
when create commandLimiter, also use localPercent to set limit
xufangping committedNov 22, 2019 Configuration menu - View commit details
-
Copy full SHA for cc4255a - Browse repository at this point
Copy the full SHA cc4255aView commit details
Commits on Nov 25, 2019
-
fix limitersMgr localPercent using bug and lock before use it
xufangping committedNov 25, 2019 Configuration menu - View commit details
-
Copy full SHA for f00d8c5 - Browse repository at this point
Copy the full SHA f00d8c5View commit details -
reportLocalStat every globalBalancePeriod,even the commandLimiter is nil
xufangping committedNov 25, 2019 Configuration menu - View commit details
-
Copy full SHA for da49bfa - Browse repository at this point
Copy the full SHA da49bfaView commit details
Commits on Nov 26, 2019
-
limit can also work on auth-disabled titan server
xufangping committedNov 26, 2019 Configuration menu - View commit details
-
Copy full SHA for 30f7d2c - Browse repository at this point
Copy the full SHA 30f7d2cView commit details -
decrease the lock range in reportStat
xufangping committedNov 26, 2019 Configuration menu - View commit details
-
Copy full SHA for bcbd5a7 - Browse repository at this point
Copy the full SHA bcbd5a7View commit details -
reportLocalStat run in itself go routine
xufangping committedNov 26, 2019 Configuration menu - View commit details
-
Copy full SHA for 1a50695 - Browse repository at this point
Copy the full SHA 1a50695View commit details
Commits on Nov 29, 2019
-
2 change qps/rate metrics 3 labels: namespace, command, localip
xufangping committedNov 29, 2019 Configuration menu - View commit details
-
Copy full SHA for a7753c4 - Browse repository at this point
Copy the full SHA a7753c4View commit details
Commits on Dec 2, 2019
-
update some config item's description and log
xufangping committedDec 2, 2019 Configuration menu - View commit details
-
Copy full SHA for fda1e66 - Browse repository at this point
Copy the full SHA fda1e66View commit details -
xufangping committed
Dec 2, 2019 Configuration menu - View commit details
-
Copy full SHA for a474656 - Browse repository at this point
Copy the full SHA a474656View commit details -
commandLimiter store globalQpsLimit/globalRateLimit in int64, use it …
…to calculate the local limit in updatePercent() and judge if limit is changed, this resolve float precision lost problem
xufangping committedDec 2, 2019 Configuration menu - View commit details
-
Copy full SHA for 8ed0698 - Browse repository at this point
Copy the full SHA 8ed0698View commit details
Commits on Dec 3, 2019
-
when all titan'a limiter qps is < devideUsage of its weight percent, …
…add current titan weight again
xufangping committedDec 3, 2019 Configuration menu - View commit details
-
Copy full SHA for 6ae93be - Browse repository at this point
Copy the full SHA 6ae93beView commit details
Commits on Dec 4, 2019
-
add showlimit.sh and add a conf parameter for setlimit.sh
xufangping committedDec 4, 2019 Configuration menu - View commit details
-
Copy full SHA for 70b3f15 - Browse repository at this point
Copy the full SHA 70b3f15View commit details
Commits on Dec 6, 2019
-
1 resolve the problem that titan still process command for remote clo…
…sed pipelined connection 2 add namespace log for readCommand failure and client processing go routine's exit
xufangping committedDec 6, 2019 Configuration menu - View commit details
-
Copy full SHA for a22ca0f - Browse repository at this point
Copy the full SHA a22ca0fView commit details -
1 BytesArray add judge for write eror
2 use remoteClosed flag to interrupt processing when pipeline connection is closed. if close ctx.Done(channel), and write() again, titan will crush for re-close channel
xufangping committedDec 6, 2019 Configuration menu - View commit details
-
Copy full SHA for 8403a21 - Browse repository at this point
Copy the full SHA 8403a21View commit details
Commits on Dec 7, 2019
-
refactor commandLimiter's qpsLimiter/ratelimiter and their globalLimi…
…t, lock, localPercent to a LimiterWrapper, and decrease the lock range
xufangping committedDec 7, 2019 Configuration menu - View commit details
-
Copy full SHA for 2d59108 - Browse repository at this point
Copy the full SHA 2d59108View commit details -
xufangping committed
Dec 7, 2019 Configuration menu - View commit details
-
Copy full SHA for b034581 - Browse repository at this point
Copy the full SHA b034581View commit details
Commits on Dec 11, 2019
-
1 in Exec(), add transaction begin, cmd args num, cmd func, reply fun…
…c metrics 2 cmd args num metrics include the key, which doesn't before 3 in AutoCommit, do adding transaction begin, cmd func, reply func metrics before log.debug()
xufangping committedDec 11, 2019 Configuration menu - View commit details
-
Copy full SHA for 3b71e69 - Browse repository at this point
Copy the full SHA 3b71e69View commit details -
simplify the msg recv/send log in debug level
xufangping committedDec 11, 2019 Configuration menu - View commit details
-
Copy full SHA for 0fb99b7 - Browse repository at this point
Copy the full SHA 0fb99b7View commit details -
fix bug of setting cmd arg num metric in Exec()
xufangping committedDec 11, 2019 Configuration menu - View commit details
-
Copy full SHA for 37c1c68 - Browse repository at this point
Copy the full SHA 37c1c68View commit details
Commits on Dec 12, 2019
-
add expire/gc round/seek/commit cost metrics
xufangping committedDec 12, 2019 Configuration menu - View commit details
-
Copy full SHA for 9de2ae9 - Browse repository at this point
Copy the full SHA 9de2ae9View commit details
Commits on Dec 22, 2019
-
prevent connection more and more: when tikv command cost high, client…
…s reconnect before it finish
xufangping committedDec 22, 2019 Configuration menu - View commit details
-
Copy full SHA for 6c2328d - Browse repository at this point
Copy the full SHA 6c2328dView commit details
Commits on Dec 25, 2019
-
lugang committed
Dec 25, 2019 Configuration menu - View commit details
-
Copy full SHA for bbfce19 - Browse repository at this point
Copy the full SHA bbfce19View commit details
Commits on Feb 18, 2020
-
1 add metrics range, fix cost exceed max value problem
2 add config item to enable/disable max-connection limit 3 add txn failure metrics in multi/exec scenario
xufangping committedFeb 18, 2020 Configuration menu - View commit details
-
Copy full SHA for 93cd7df - Browse repository at this point
Copy the full SHA 93cd7dfView commit details -
Merge branch 'fpxu_dev' into 'master'
Fpxu dev See merge request zz-arch/zhuanzhuan_zzkv!13
xufangping committedFeb 18, 2020 Configuration menu - View commit details
-
Copy full SHA for 7e2521b - Browse repository at this point
Copy the full SHA 7e2521bView commit details
Commits on Feb 19, 2020
-
1 add example for limit-connection and max-connection-wait in titan.toml
xufangping committedFeb 19, 2020 Configuration menu - View commit details
-
Copy full SHA for ad7cff1 - Browse repository at this point
Copy the full SHA ad7cff1View commit details -
1 fix unlock bug in limit-connection
xufangping committedFeb 19, 2020 Configuration menu - View commit details
-
Copy full SHA for aeca4b3 - Browse repository at this point
Copy the full SHA aeca4b3View commit details -
don't lock s.serverctx.lock when limit-connection disabled
xufangping committedFeb 19, 2020 Configuration menu - View commit details
-
Copy full SHA for bb617b0 - Browse repository at this point
Copy the full SHA bb617b0View commit details
Commits on Feb 25, 2020
-
expire seek end in at:now keys to reduce rocksdb tomstone problem
xufangping committedFeb 25, 2020 Configuration menu - View commit details
-
Copy full SHA for 003e6b6 - Browse repository at this point
Copy the full SHA 003e6b6View commit details
Commits on Feb 26, 2020
-
fix a failed case in tests/redis/unit/expire.tcl
xufangping committedFeb 26, 2020 Configuration menu - View commit details
-
Copy full SHA for 4423eaf - Browse repository at this point
Copy the full SHA 4423eafView commit details
Commits on Feb 27, 2020
-
expire seek start in last processed expireKeys to reduce rocksdb toms…
…tone problem
xufangping committedFeb 27, 2020 Configuration menu - View commit details
-
Copy full SHA for cc15799 - Browse repository at this point
Copy the full SHA cc15799View commit details -
xufangping committed
Feb 27, 2020 Configuration menu - View commit details
-
Copy full SHA for d9a1baf - Browse repository at this point
Copy the full SHA d9a1bafView commit details -
also reduce expire seek range when no expire keys or all expire keys …
…> now
xufangping committedFeb 27, 2020 Configuration menu - View commit details
-
Copy full SHA for 83a370d - Browse repository at this point
Copy the full SHA 83a370dView commit details
Commits on Feb 28, 2020
-
also reduce expire seek range when no expire keys or all expire keys …
…> now
xufangping committedFeb 28, 2020 Configuration menu - View commit details
-
Copy full SHA for d75dd34 - Browse repository at this point
Copy the full SHA d75dd34View commit details
Commits on Mar 2, 2020
-
comment unsupported string functions in command list, and delete its …
…redis test case
xufangping committedMar 2, 2020 Configuration menu - View commit details
-
Copy full SHA for 3519ff9 - Browse repository at this point
Copy the full SHA 3519ff9View commit details -
comment unit test of unsupported string functions in strings_test.go
xufangping committedMar 2, 2020 Configuration menu - View commit details
-
Copy full SHA for c4eea83 - Browse repository at this point
Copy the full SHA c4eea83View commit details
Commits on Apr 21, 2020
-
hash expire-key, it will improve the keys num handled every seconds, …
…and prevent that current expire-keys region writing node have higher load than other nodes
xufangping committedApr 21, 2020 Configuration menu - View commit details
-
Copy full SHA for bd43ec2 - Browse repository at this point
Copy the full SHA bd43ec2View commit details
Commits on Apr 24, 2020
-
1 fix runExpire's problem that unhashed goroutine scan hashed expire-key
2 fix expire_test.go: gc key can get before runExpire/doExpire if expireat < now; add 2 testCases for hash/string expire: check key is deleted and gc key exists after runExpire
xufangping committedApr 24, 2020 Configuration menu - View commit details
-
Copy full SHA for fe6e84b - Browse repository at this point
Copy the full SHA fe6e84bView commit details
Commits on Apr 26, 2020
-
unhash expire goroutine use individual limit configuration item、expir…
…ed&round&seek&commit metrics label
xufangping committedApr 26, 2020 Configuration menu - View commit details
-
Copy full SHA for 977b457 - Browse repository at this point
Copy the full SHA 977b457View commit details -
buckets of comand/limit/commandFunc/txn commit cost is too many to lo…
…ad for dashboard, replace 1.4 with 2, buckets num decrease 50%
xufangping committedApr 26, 2020 Configuration menu - View commit details
-
Copy full SHA for 9161d7e - Browse repository at this point
Copy the full SHA 9161d7eView commit details