Discussion about this post

User's avatar
jpickle777's avatar

Jack,

I posted this reply to you originally in article by Michael Sellers . Posted here at your request. This version is slightly revised from the original.

You bring your engineering expertise and political activism to an important issue. (I do not have either type of background, so please take my comments with a grain of salt.)

I'd like to offer a few ideas, with every intent to be constructive.

1- I would not use the term "confused" because this implies one is not thinking clearly; bewildered.

2- You have concluded that the reason people are easily deceived by political messages is that they have low political truth literacy.

3- There might be some additional contributing variables (i.e., covariates) that you've not considered such as risk aversion (e.g., averse to making a mistake) or gullibility/ naivety, or age, educational level, or gender, or experience voting, etc.

4- Realistically, in politicians' statements (or derivative reporting), there might be "kernels of truth" embedded in otherwise deceptive statements, causing recipients to rely on the kernel to believe the whole message. Or, inevitably, they bring background knowledge /misconceptions to the task that affect responses.

4a- have you considered this part-whole problem when constructing your hypotheticals?

4b- I notice your Q is - "how true do you feel that claim is?" Given that you are studying deception detection, have you considered

(i) "how deceptive do you feel that claim is?" I know the sounds a bit odd but you know that survey results can be easily skewed by how a question is framed.

(ii) Consider the possibility that truth detection and deception detection involve different cognitive resources (e.g., if I hear something true, I will know it right away; versus, if I hear a lie, I will need to mull it over and weigh it against my knowledge and experience).

(iii) Also, do you mean to ask how the participants feel or how they <think>?

5- I have skimmed your articles. Looking at Figure 7 in the 2024 media literacy paper, it appears you ask participants to judge truthfulness of complex political statements using a common survey approach (6-point Likert scale with midpoint "can't decide") followed by the question "If the election were held today and this was all the information you had, how much impact would what the politician claimed have on your decision to vote for or against the politician?" (9-point Likert with neutral midpoint).

6- In research, when using reading as the input modality, you should do a readability index on each hypothetical politician’s claim (so assure reading level is uniform and at the optimal level such as 8th grade, and that your hypotheticals are of uniform difficulty).

7- You are using a Likert scale to judge perceived truthfulness of a hypothetical politician’s claim, yet the actual choice in the voting booth is a "forced choice." This begs the question -- based on your hypothetical political statement -- how would your participants <actually> vote?

8- Would those with low deception detection vote for the deceptive candidate and those with high deception detection <not> vote for deceptive candidate?) In reality, if a candidate is perceived to be less than truthful but otherwise perceived to be likable, charismatic and highly effective as a business leader, celebrity or former president, individuals might actually vote YES even when they perceive the candidate’s truthfulness to be low (i.e., they detect deception but like him anyway). 2 X 2 grid: x-axis VOTE YES-NO; y-axis TRUTHFUL HIGH-L0W. Assuming you have enough participants, I wouldn’t be surprised if you have some in all four cells.

9- Again, offered merely as constructive suggestions -- You might want to consider a hypothesis-testing approach rather than solely a survey method. Consult an experienced statistician to develop a testable hypothesis, do a power analysis to determine the right # of participants (depending on number of variables), use some independent variables.

10- e.g. Misinformation Susceptibility Test, MIST - https://link.springer.com/article/10.3758/s13428-023-02124-2), and analyze results with appropriate statistical tests.

Hope this offers some food for thought.

You've done an enormous amount of thinking and work on an important topic.

Best of luck, J.H.!

Expand full comment
Eudoxia's avatar

thank you indeed, very interesting! another issue that I think should be thrown in the mix - why don't more truthful people stand as politicians? it seems to me that in the US and increasingly in other countries, the principled and the truthful don't stand for election as politicians because they are concerned about the negative impact on them and their families - even loss of life, as we have seen recently. but at the very least, they and their families will be subjected to a hurtful and harmful tsunami of lies about them, their past, their relationships etc. I believe in Europe the MSM has an unwritten but respected code not to report on politicians families or their private lives unless something like corruption is exposed. And of course, politicians have to appeal to/ appease rich donors. Possible solutions: (1) legislative restrictions against reporting on politicians' families and private lives - except where crime is involved - in the interests of 'national security'. (2) randomn selection every 3/ 4 years of at least a substantial proportion of all politicians out of the pool of those eligible to vote. Some minimal reading and writing skills might be required. The person selected would be entitled to refuse to act, of course. Not sure how to address the US problem of people being registered with the major parties which would immediately give an effect one way or another - as opposed to other countries where voters don't register with any party and so a randomn selection would not show up as indicative of how the selectees would vote. If you see what I mean.

Expand full comment
18 more comments...

No posts