Blog Four

Blog Four


Since my last blog post, I have had to make an adjustment to my study’s design.  With the upcoming showcase only one month away, there is not enough time to recruit all of the judges we anticipated. Result presented at the showcase will address all of our original research questions, except judge effects, which we will look into in the coming months.

During the past few weeks I have been working to recruit judges from each domain of our study: visual arts, writing, music, and psychology.  Unfortunately, the results of these efforts will not be ready for the upcoming showcase.  Recruiting judges and depending on them for our data under this short deadline is not feasible. After realizing this setback, we brainstormed for other methods to obtain the data we need within our time restraints. To do so, we have adjusted the design of our study so that, for the time being, we will now be using four experts (2 male, 2 female) in the field of psychology of creativity to serve as the judges of the creative productions.

We are maintain our original design with an adjustment to the judge pool, in order to gather data n time for the showcase.  As mentioned, we have four experts who will be judging the creative productions at hand.  In addition to this set of judges, 48 judges will be recruited, and creative productions will be divided into three groups. Group 0: the anchor group that consisted of 30 participants who completed creative productions in each domain under examination, which all judges would score and would serve to calibrate judges.  Group 1 & 2 which productions were randomly assigned to and would be randomly assigned to judges.  This design was meant to reduce the amount of time each judge would need to contribute to the study.

With the adjustment to the design, our four judges will now be responsible for scoring all creative productions in the study.  This will be quite a time consuming task- Thank you judges!

I have learned a lot (especially recently) from this program.  The importance of planning is something that stands out to me. Although we had a plan and general idea for our study design since we applied for this program, in the future a timeline may be very helpful.  It isn’t possible to predict all of the obstacles one may encounter while conducting research, but having a general timeline could help in avoiding some.  I’ve also learned that as a researcher you have to be flexible.  Not everything will go as planned, but making the best of a situation is important!

Blog Three

Since the start of the Spring Semester Dr. Barbot and I have made a lot of progress.  In December, I began to filter through thethousands of participants who participated in at least some part of the data collection.  Participation ranged from completing one drawing and a self-esteem measure to completing four drawings, a story, musical piece and self-esteem measure. I was looking for participants who matched demographically to the participants of our pilot study, which we presented in May of 2014.  A subsample of participants was selected to match the total sample in terms of gender, age, and other background information. The subsample was created in order to equilibrate the number of productions in each of the domains under investigation.  We have chosen a sample of 170 participants, 42 of which were the subjects of last year’s pilot study.






Sample Size





Mean Age






Now that we have a final sample, creative writing productions are being transcribed and translated from French to English.  Of the 170 participants, 113 completed the convergent integrative creative writing task. We have hired a native French speaker to complete this task, which will allow the productions to be scored by English-speaking judges.

With all of our participants chosen and data organized, it is now time to find experts from each domain of our study: visual arts, writing, music and psychology, to score the creative productions from each participant.  Currently, we are looking for individuals with experience in each field and we are compiling a list of potential judges through our own personal contacts.  The next step will be to administer an information questionnaire to each of the experts.  The questionnaire I created consists of demographic questions as well as a Creative Achievement Questionnaire (CAQ). This will help account for individual differences among judges and could evolve into an interesting examination of factors that influence judgment of creative productions.

All creative productions will be scored by experts using the consensual assessment technique (CAT) through an interface called CAT-I. Judging is a time consuming process, therefore we will break the productions up into groups to make it more manageable for judges.  Group 0 will consist of 30 participants who are the same across all domains. This group will serve as an “anchor” to calibrate judges for individual differences in severity and discrimination (variability).  Group 1 and Group 2 were randomly selected and vary across domains.  Each judge will score creative productions from group 0 as well as creative productions from either group 1 or group 2.  I am looking forward to analyzing the data we collect!

Blog Two

Thus far, we have made substantial progress in our research endeavor.  Our current project is an extension and advancement of a previous pilot study we conducted.  The data we will analyze has already been collected, however it must be merged and organized.  Once merged, we must find participants who best fit our pilot study, on the demographic level.  To do this we have been working with an unfamiliar software- Multivariate and Propensity Score Matching Software: The Matching Package for R.  A great amount of my time has been spent working on this process.

Once this is complete, participants will be chosen and creativity works will have to go through the scoring process. A section of the creative works are writing compositions.  These were all done by French students- in French.  In order to score the productions sufficiently these works must be translated and transcribed into English.  We have already arranged to have this process completed by a native French-speaking student.

Our next step will be choosing judges to score all of the creative productions.  In order to control for judge-specific differences, I have created a survey that all potential judges will take.  The survey consists of several demographic questions as well as a Creative Achievement Questionnaire.  This information has potential to expand into a study of judge characteristics and effects on scoring which could be an interesting add on to our project.

In the pilot study previously conducted, analyses showed significant correlations in our data.  First, students who received a high creativity score in drawing were also found to have high creative self-esteem.  We also found students who received high creativity scores in music or writing tended to score low on self-concept clarity.  When analyzing the expanded data we expect to find similar results, perhaps with higher significance and maybe something new!

Blog One

Creative potential, Self-Esteem, and Self-Concept Clarity: a Multi-domain, Multivariate approach

Our research is focused on creative potential across domains and the relationship it holds with different dimensions of self-esteem in adolescence. Thus far, we have established creative potential (in visual arts, music and story-writing) to be a mainly domain-specific ability and we have also found several significant associations between different domains of creativity and sub-domains of self-esteem including, creative self-esteem and self-concept clarity. These pilot results were presented by our research group, the IDID Lab, at the Pace University’s Psychology Conference this May.

The purpose of this project is the extension and refinement of our ongoing research. Specifically, we plan to:

  1. Increase the sample size to increase both internal and external validity of our results.
  2. Involve a larger and more diverse panel of experts to gauge how the study results are consistent across domains of expertise.

An aspect of our research relies on the expertise of judges to score the creative productions completed by the study participants. As mentioned, part of our plan extend our project is to increase the number and diversity of judges involved in the scoring process. To do this, we will include experts from multiple domains of expertise including visual arts, music, and writing.

We suspect that the diversity in judges may show some new associations between the creative domains and and self-esteem dimensions, due to the judge’s domain of expertise.