Data
This page allows you, according to your rights on the application, to add data to your project and to follow the progress of the processing of these data.
It also allows you to view the time series of events.
To learn how to add data, go to Adding data to a project
Anomalies report
The page also displays all the files that were added to the project, and for each file, an anomaly report is available as soon as the lines of the files were checked during the ingestion of the file.
This report warns you if your quota limit has been reached and/or if the lines of the file are invalid or contain mistakes. You can open this anomaly report by clicking on the following button in the Anomalies column (the button doesn't appear if the file has no anomaly):
After clicking on the button, the report window opens:
This window is composed of at most 3 parts: Discarded lines, Warning Lines and Quotas reached
Each part only appears if there were issues related to it.
Discarded lines
The Discarded lines part will provide you with information regarding the lines of the file that were discarded during the ingestion, and which are consequently not taken into account in the project.
You can find the total number of lines that were discarded and the reason why they were discarded. Here are the possible reasons:
- Invalid caseId: a line that has no value for its caseId column will be discarded
- Invalid task: a line that has no value for its task column will be discarded
- Invalid timestamps: a line that has not a single valid timestamp will be discarded
Each of those is optional and will not appear if the values of the column are all valid
In the report example displayed above, a total of 6 lines were discarded. * 3 lines were discarded because their caseId column was invalid * 5 lines were discarded because their task column was invalid * 4 lines were discarded because their timestamps were invalid.
Please note that one line that has an invalid caseId, an invalid task and invalid timestamps will be counted as discarded in each of the caseId, task and timestamp categories, but is only counted once in the total number of discarded lines for the file.
If all the lines of the file are discarded, the ingestion of the file will fail.
Warning lines
The Warning lines part will provide you with information regarding the lines of the file that have invalid values in some timestamp and metric columns, but for which the issue may not lead to the line being discarded. Instead, the incorrect value is simply not used, and the line is kept.
The columns that may not lead to the line being discarded are the following:
- Timestamp columns: In the case where the value for one timestamp column is invalid, if the line has a valid value in another timestamp column, the line is not discarded and will use the valid timestamp as the start and end date of the task. This is why for each timestamp column you can find warnings regarding the lines that have an invalid value. For a given line, the column is invalid if there is no value or if the value doesn't correspond to the date format associated with the column. An example of an invalid value is provided if there is at least one value that doesn't correspond to the date format. Information regarding the lines that were discarded because all their timestamp columns were invalid can be found in the Discarded lines part.
- Metric columns: For the metric columns, a value is considered invalid if it doesn't correspond to a number. Such a value is simply not taken into account, as if no value was defined. This is just a warning which doesn't lead to the line being discarded.
For each timestamp and metric column, the warning information is optional and will not appear if the values of the column are all valid
In the report example displayed above: * For the timestamp column at index 2, 6 lines have an invalid value, and one of those invalid values is 2023/10/30-12:30 as it doesn't correspond to the dd/MM/yyyy HH:mm date format that is associated with the column * For the timestamp column at index 3, 5 lines have an invalid value, and no example is given as all the invalid cells have no value * For the price metric column, 4 values were not numbers, and one of those invalid values is twelve * For the quantity metric column, 3 values were not numbers, and one of those invalid values is ten
Please note that the lines counted for each column may overlap (for instance if a line has an invalid value for both timestamp columns and for the price metric, it will be counted as one invalid line for each timestamp column and for the price metric)
Quotas reached
The Quotas reached part will provide you with information if the cumulative and/or simultaneous cases quotas are exceeded because of the ingestion of the file
In the report example displayed above:
- For the cumulative cases quota, before the ingestion of the file the quota limit was not reached as there was only 1 case and the limit is 2 cases, but as the ingestion of the file adds 3 cases the limit is exceeded
- For the simultaneous cases quota, before the ingestion of the file the quota limit was not exceeded as there was only 1 case and the limit is 1 case, but as the ingestion of the file adds 3 cases the limit is exceeded
For each type of quota, the information is optional and only appears if the limit is exceeded
If one of the quotas is exceeded during the ingestion of a file, the events of the file are not added to the project and the ingestion fails
More information regarding the different quota types is available here