Skip to content

Mergemaster0620 - #12779

Merged
JackieTien97 merged 97 commits into
ty/TableModelGrammarfrom
mergemaster0620
Jun 21, 2024
Merged

JackieTien97 merged 97 commits into
ty/TableModelGrammarfrom
mergemaster0620

Conversation

@JackieTien97

Copy link
Copy Markdown
Contributor

merge master

JackieTien97 and others added 30 commits June 4, 2024 17:10
Optimize error message when creating unsupported data type
…TsFileExtractor parameters & Subscription: avoid poll messages from unsubscribed topics (#12648)

* Pipe: fix uninitialized config when validate PipeHistoricalDataRegionTsFileExtractor parameters

* Subscription: avoid poll messages from unsubscribed topics
* JDBC: Fix ArrayOutOfBoundException when calling getBytes

* Update JDBCCharsetExample.java
…in connector pending queue tsfiles to block the forwarding of realtime requests (#12668)
* Migrate to Develocity Maven Extension
* Update to Common Custom User Data Maven Extension 2.0
…information (#12643)

* add import-schema.sh/bat and export-schema.sh/bat in cli/tools

* fix import schema

* fix import schema

---------

Co-authored-by: 2b3c511 <rong.li@timecho.com>
…onsensus UT not binding to the corresponding port (#12674)

* fix concurrent

* fix concurrent
)

Co-authored-by: Steve Yurong Su <rong@apache.org>
* finish

* use concurrentskiplist

* bug fix

---------

Co-authored-by: OneSizeFitQuorum <tanxinyu@apache.org>
shuwenwei and others added 28 commits June 17, 2024 09:42
* fix compaction npe when set modified status

* check empty page
* support show ttl on pathPattern

* fix UT

* modify details
* enable wal compression

remove metrics in mem table flush task, cache hash code in partial path, use gzip to compress wal

batch update metrics

* fix bug

* fix compilation problem

* remove useless code

* recover some code

* support compression type in WAL Compress Header

* support multi version WAL

* edit configuration item

* add log for WAL size

* temp for debug

* fix bug

* remove useless log

* remove one configuration

* use compression rate to update wal disk usage

* fix ut

* fix test

* set default to uncompress

* fix wal ut

* optimize calculating of wal size

* close wal file when the origin size of wal buffer is larger than threshold

* add the size of magic string

* may be fix the bug

* fix with comment

* edit with review

* fix test

* add test for wal compression

* add hot reload

* clean the code to make it more readable

* reuse the byte buffer if possible

* Indicate the encoding of String

* Edit according to comment

* spotless
* check duplicate key in start node script

* modify stop node scripts

* use \n as line separator

* fix config node send showConfiguration to config node classCastException
* file fileOverlap is not correctly marked

* fix repair compaction may generate too large chunk
…sFile (#12765)

Currently we read the metadata of all devices and measurements when constructing a TsFileInsertionDataContainer. This is both time-consuming and memory-wasting if only a few devices match the pattern. This PR filters the devices by pattern before reading the metadata of devices and measurements, saving memory and I/O cost when there are many unmatched devices.

Note: this only works when TsFile metadata are not cached (due to high memory usage of TsFile metadata cache), because cached metadata can not be filtered so that pipes with arbitrary patterns can use it.

---------

Co-authored-by: Steve Yurong Su <rong@apache.org>
…nclude "lastEvent" into pipe's event count metrics & Removed the "userConflict" judgment to data sync failure caused by METADATA_ERROR (#12758)
…opped (#12753)

Co-authored-by: Steve Yurong Su <rong@apache.org>
…hput (#12735)

Co-authored-by: Steve Yurong Su <rong@apache.org>
@JackieTien97
JackieTien97 merged commit 0343fc2 into ty/TableModelGrammar Jun 21, 2024
@JackieTien97
JackieTien97 deleted the mergemaster0620 branch June 21, 2024 00:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.