I was very excited to upload my data and get new insights from my datasets. But the results I got disappoint me very much.
The first data set contained summarized data, mean values of the items in my survey, differentiated by occupational group. I knew this was not the ideal basis for an analysis by Chartpixel, but the key-insight got it completely wrong. High values in my data represented a risk, low value a secure environment. But the “key-insights” by the AI interpreted high values as positive, low values as negative. There is no input option to tell Chartpixel how to interpret the values. This is why the automatic analysis, immediately after uploading the data, came to the wrong conclusions.
Furthermore, Chartpixel seems to read causal relationships from my data, which it does not contain at all. I only have one measurement point in my data and yet the AI formulates that one variable predicts the values of the other, i.e., that it is a predictor. Unfortunately, I cannot find any information in the evaluation or in the charts as to which statistical analyses lead to this statement. There is therefore no way of understanding the results even from a math point of view.
I have uploaded a second data set that contains raw data from 90 people. Even though the data set is rather small, it should now be data that Chartpixel can process reliably. This is what the support team said in response to my feedback after the first attempt.
Although I had uploaded a German-language data set and the output language is set to German, I received all item descriptions in the charts in English. The meaning of the item names had been changed by the translation.
One statement in the “key insights” of this evaluation was: “Time Management leads the self-assessment of work quality.” Apart from the fact that the term time management does not even appear in my data set, the content of this statement is incomprehensible to me.
Again, there is no explanation as to how the AI arrived at this result and which items from my questionnaire were included in the variable “time management”, which was presumably constructed by the AI.
Apart from the fact that the content of the statement is incomprehensible to me, I would have no way of explaining to my listeners, to whom I present the results, how these conclusions were drawn from the data. In my view, there is a lack of transparency in the calculations and this leads to a lack of my trust in the calculations and interpretations.
I could mention other points that seem strange to me in Chartpixel's evaluation of this data set, but I don't want to make the text too long.
My conclusion is that the high expectations I had after reading the very positive reviews were not fulfilled. For the kind of data, I want to analyse, e.g., from employee surveys, Chartpixel seems unsuitable. I will ask for a refund.