Q: Why Ultipa Transporter won't connect with Ultipa server? The server is deployed on Ultipa Cloud
A: If the Ultipa server is deployed on Ultipa Cloud, the IP of client end , from where the Ultipa Transporter runs, needs to be added to the InBound Allowed IPs under Network Settings of this server, on the page of Ultipa Cloud.
Q: Got error message 'rpc error: code = ResourceExhausted desc = Received/Sent message larger than max (31324123 vs. 4194304)', what does it mean and how to solve it?
A: This message means when importing/exporting a data batch, the packet size which is 31324123 bytes exceeds the limit of 4194304 bytes.The possible reasons are too many properties imported at a time, excessive property volume (long texts stored in text type), or too large batchSize that has been set, as a result of which the data volume of a data batch exceeds the default server config of max_rpc_msgsize (4M) and/or the MaxPacketSize of Go SDK (40M).
Solution A: reduce the
batchSize in the config file
Solution B: raise the setting of
MaxPacketSize in the config file, and/or
max_rpc_msgsize in the server config (the latter requires a server re-boot).
Q: What format is required when importing time values?
A: Please follow below format examples:
- [YY]YY-MM-DD HH:MM:SS
- [YY]YY-MM-DD HH:MM:SSZ
Supports year of 4-digit or 2-digit (2-digit year will be parsed as 19xx if year≥70, or parsed as 20xx if year＜70; supports month and day of 2-digit or 1-digit; dash (-) can be replaced with slash (/);
[+/-]0x00 stands for
-0300 dependent, and Z stands for UTC 0 timezone.
Q: What timezone is used for the exported time values?
A: Value of datetime has no timezone information, value of timestamp will be exported according to the parameter
timezone setting, or in local timezone if
timezone is not set.
Q: Can data fields with names
_to_uuid be declared as string or uint64?
A: No. For any data field representing a system property, it should be configured as the name of the corresponding system property. If a data field has same name with a system property but not representing that system property, either should it be configured as _ignore hence will not be imported, or be renamed through parameter
Q: Got warning message 'bare " in non-quoted-field' or 'extraneous or missing " in quoted-field', what do they mean and how to solve them?
A: These two warnings are related to the double quotation in the data field.
quotes set to false, a double quotation in a data field will be parsed as the boundary wrapping around the content of this data field (not being recognized as the content and must be located in the begining and end of the content), two consecutive double quotations will be parsed as the character of double quotation (part of the content). For instance, importing some content
I like when Jack said "If you jump I jump". while
quotes is false will definitely trigger warnings, and the content should be revised into
"I like when Jack said ""If you jump I jump""." in order to be imported correctly.
quotes set to true, a double quotation will be parsed as the character of double quotation itself (part of the content), hence the data field content in the above example can be imported correctly without any data preprocessing.
Q: How to preprocess data when there are double quotations, commas and line breaks in the CSV?
A: Below are the solutions for each symbol presenting separately in a data field. A conservative solution should be elected if more than one symbol presents.
For double quotations, please refer to the previous Q&A.
For commas, if
separator is also using comma then the data field content should be warpped with double quotations to prevent the comma from being parsed as separator, in which case the
quotes should be false; otherwise, no data preprocess is needed.
For line breaks, must wrap the content with double quotations and guarantee that
quotes is false.
Q: Why a field in the CSV file with value 'null' won't be imported as null value?
A: The field 'null' in a CSV file will be parsed as a string whose value is 'null'. Only an empty field will be parsed as null, i.e., two consecutive field separators.