[pixels-cli] the data query for load cannot be found

[gengdy1545]

The data was successfully imported and the file exists, but it cannot be queried using the Trino CLI.

[gengdy1545]

The timestamp for loading the data is 2431107, but the timestamp used for the query is 2411015.

[gengdy1545]

This may be an issue with the consistency of the high watermark and low watermark. We will retest after clearing the persistent data in etcd.

[bianhq]

This is likely caused by dead uncommitted write transactions.

[bianhq]

@gengdy1545 Please confirm if this issue still exists.

[gengdy1545]

The root cause indeed lies in dead uncommitted write transactions. One idea is to introduce a timeout mechanism, but this may impact long-running write transactions.

[bianhq]

The root cause indeed lies in dead uncommitted write transactions. One idea is to introduce a timeout mechanism, but this may impact long-running write transactions.

We can solve this issue by adding a lease to TransContext. The transactions in pixels-sink or retina should check the lease periodically or upon each write operation, and extend the lease when it is expiring. The transaction server can abort and vacuum expired transactions periodically.

[bianhq]

I am resolving this issue.