Contrary to Popular Belief, Cornell is not a Safety School

Investigating AI’s Ability to act as College Counselors
LLMs
Advising
College
Author

Kendall Allen

Published

March 10, 2024

Introduction

Recently, our class has been engaging in discussions about AI’s potential to do nearly any job. I’ve tried not to think too much about this or my brain will go numb, but I was on a call with a Penn Undergraduate Pre-Grad School advisor and wondered: could AI do this woman’s job as a college counselor? She not only had personal relationships with many different universities, but her wealth of knowledge spanned far beyond basic “google-able” information I would be able to find on my own. Thus, the idea for this blog post was born: let’s see how well ChatGPT functions as a college advisor for hypothetical high school students.

Where should I apply?

I decided to start off my exploration simply asking ChatGPT what schools students should apply to given their preferences. Knowing the general information and colloquial “vibes” of many colleges was going to be critical for the platform’s ability to work as a college counselor, so this seemed like an important place to begin.

Prompt:

I am a college junior looking to apply to 10 colleges in the US. I want to go to small school in a college town that has a somewhat strong emphasis on sports. Please give me a list of the 10 colleges to which I should apply.

Sure, here’s a list of 10 colleges in the US that fit your criteria:

  1. Davidson College - Located in Davidson, North Carolina, this small liberal arts college has a strong emphasis on academics and a competitive NCAA Division I sports program.

  2. Williams College - Situated in Williamstown, Massachusetts, Williams College is known for its strong academics and vibrant college town atmosphere. It also has successful sports programs, particularly in Division III athletics.

  3. Amherst College - Another prestigious liberal arts college located in Amherst, Massachusetts, Amherst College offers a tight-knit community and competitive sports teams, competing in Division III.

  4. Middlebury College - Nestled in Middlebury, Vermont, Middlebury College boasts a beautiful campus and a robust sports culture, competing in Division III athletics.

  5. Colby College - Located in Waterville, Maine, Colby College offers a small college town setting with a focus on rigorous academics and competitive Division III sports teams.

  6. Claremont McKenna College - One of the Claremont Colleges in Claremont, California, Claremont McKenna College provides a small college town atmosphere and strong emphasis on both academics and Division III sports.

  7. Bucknell University - Situated in Lewisburg, Pennsylvania, Bucknell University combines a picturesque campus with strong academics and competitive NCAA Division I sports teams.

  8. Lafayette College - Located in Easton, Pennsylvania, Lafayette College offers a classic college town setting along with rigorous academics and competitive Division I sports programs.

  9. Kenyon College - Found in Gambier, Ohio, Kenyon College provides a close-knit community and competitive Division III sports teams, particularly in swimming and cross country.

  10. Trinity College - Situated in Hartford, Connecticut, Trinity College offers a vibrant college town experience, strong academics, and competitive Division III sports teams.

These colleges offer a blend of small college town atmospheres, strong academics, and robust sports programs, which align with your preferences. Make sure to research each college further to ensure they meet all your criteria before applying. Good luck with your applications!

Prompt:

I am a college junior looking to apply to 10 colleges in the US. I want to go to big school in an urban environment with a good engineering program. I don’t want there to be a large emphasis on Greek Life. Please give me a list of the 10 colleges to which I should apply.

Certainly! Here’s a list of 10 colleges in the US that fit your criteria of being a big school in an urban environment with a strong engineering program and a relatively low emphasis on Greek Life:

  1. Massachusetts Institute of Technology (MIT) - Located in Cambridge, Massachusetts, MIT is renowned for its top-tier engineering programs and is situated in the vibrant urban area of Greater Boston.

  2. California Institute of Technology (Caltech) - Situated in Pasadena, California, Caltech offers outstanding engineering programs in a bustling urban environment near Los Angeles.

  3. Carnegie Mellon University - Located in Pittsburgh, Pennsylvania, Carnegie Mellon is known for its strong engineering programs and is situated in an urban setting with numerous opportunities for industry collaboration.

  4. Georgia Institute of Technology (Georgia Tech) - Situated in Atlanta, Georgia Tech offers excellent engineering programs within a major urban center, providing ample opportunities for internships and career prospects.

  5. University of California, Berkeley (UC Berkeley) - Located in Berkeley, California, UC Berkeley offers a renowned engineering program and is close to the vibrant city of San Francisco.

  6. University of Illinois Urbana-Champaign (UIUC) - UIUC offers top-ranked engineering programs and is situated in the lively college town of Urbana-Champaign, Illinois.

  7. University of Michigan - Ann Arbor - Located in Ann Arbor, Michigan, the University of Michigan offers strong engineering programs and is set in a bustling urban environment with diverse opportunities for students.

  8. Purdue University - West Lafayette - Situated in West Lafayette, Indiana, Purdue University boasts excellent engineering programs and is set in a vibrant college town with easy access to nearby cities like Indianapolis.

  9. Northwestern University - Located in Evanston, Illinois, just north of Chicago, Northwestern University offers a strong engineering program within reach of the cultural and professional opportunities of a major urban center.

  10. University of Southern California (USC) - USC is located in Los Angeles, California, offering strong engineering programs and access to one of the largest urban environments in the United States.

These universities provide a blend of urban environments, strong engineering programs, and a relatively low emphasis on Greek Life, which align with your preferences. Be sure to research each university further to ensure they meet all your criteria before applying. Good luck with your applications!

Prompt:

I am a college junior looking to apply to 10 colleges in the US. I want to go to mid-sized school in a suburban environment that isn’t very hard to get into but offers high quality academics. I want to feel comfortable there as a black woman. Please give me a list of the 10 colleges to which I should apply.

Certainly! Here’s a list of 10 colleges in the US that fit your criteria of being mid-sized, situated in suburban environments, offering high-quality academics, and fostering a welcoming environment for black women:

  1. Spelman College - Located in Atlanta, Georgia, Spelman College is a historically black women’s college known for its strong academic programs and supportive community.

  2. Howard University - Situated in Washington, D.C., Howard University is a historically black university offering a wide range of academic programs and a vibrant campus life.

  3. University of Maryland, Baltimore County (UMBC) - Located in Baltimore County, Maryland, UMBC is known for its strong academic programs and diverse student body, offering a welcoming environment for black women.

  4. Xavier University of Louisiana - Located in New Orleans, Louisiana, Xavier University is a historically black university known for its strong academic programs and supportive community.

  5. University of North Carolina at Charlotte - Situated in Charlotte, North Carolina, UNC Charlotte offers a range of academic programs and a diverse student body in a suburban setting.

  6. George Mason University - Located in Fairfax, Virginia, George Mason University offers high-quality academics and a diverse student population in a suburban environment near Washington, D.C.

  7. Rutgers University - New Brunswick - Situated in New Brunswick, New Jersey, Rutgers University offers a range of academic programs and a diverse student body in a suburban setting not far from New York City.

  8. University of Delaware - Located in Newark, Delaware, the University of Delaware offers strong academic programs and a welcoming environment for students of all backgrounds in a suburban setting.

  9. University of Connecticut - Storrs - Situated in Storrs, Connecticut, the University of Connecticut offers a range of academic programs and a diverse student body in a suburban environment.

  10. University of Massachusetts Amherst - Located in Amherst, Massachusetts, UMass Amherst offers high-quality academics and a diverse student body in a suburban setting in the Pioneer Valley region.

These colleges provide a mix of suburban environments, high-quality academics, and supportive communities that should make you feel comfortable as a black woman. Be sure to research each college further to ensure they align with your specific preferences and goals. Good luck with your applications!

Observations

These lists honestly were really accurate to the ones a college counselor might provide. The platform clearly understood what I was looking for, and offered schools that fit my general priorities. While the individual descriptions were somewhat vague, the contents of the lists were appropriate and well-thought-out. I think consulting an LLM for initial research like this would be incredibly helpful to get a general understanding of what schools you might like! I was also impressed with its ability to adhere to my request about prioritizing the comfort and experience for a POC woman.

What should be the topic of my personal essay?

Another critical part of a college advisor’s role is to help students write their personal statements for the Common Application (colloquially called the Common App). Real counselors don’t normally tell students exactly what experience or theme to write about, so I didn’t expect this of ChatGPT, I just asked it to give me advice regarding how to go about thinking of ideas.

Prompt:

What should I write my Common App personal essay about?

Response:

Choosing a topic for your Common App personal essay can be a deeply personal decision, but here are a few potential approaches to consider:

Significant Life Experience: Reflect on a moment or experience that had a profound impact on your life. This could be overcoming a personal challenge, a cultural experience that broadened your perspective, or a moment of personal growth.

Passion or Interest: Write about something you’re truly passionate about. Whether it’s a hobby, a field of study, or a cause you deeply care about, sharing your enthusiasm can give admissions officers insight into who you are beyond your academic achievements.

Identity and Background: Explore how your identity, background, or cultural heritage has shaped your perspective and influenced your goals. This could include discussing your family background, cultural traditions, or experiences as a member of a marginalized community.

Failure and Resilience: Reflect on a time when you faced failure or adversity and how you responded to it. Admissions officers are often interested in seeing how applicants handle setbacks and challenges, as it demonstrates resilience and maturity.

Personal Growth and Reflection: Discuss how you’ve evolved as a person over time. This could involve reflecting on lessons learned from past experiences, changes in your worldview, or moments of self-discovery.

Impactful Relationships: Write about a person who has had a significant influence on your life. This could be a family member, teacher, mentor, or friend. Explore how this relationship has shaped your values, aspirations, or personal development.

Unique Perspective or Experience: Share a story or perspective that sets you apart from other applicants. This could be an unusual hobby, an unconventional life experience, or a unique talent or skill.

Ultimately, the most important thing is to choose a topic that feels authentic to you and allows you to showcase your personality, values, and strengths. Once you’ve selected a topic, focus on crafting a compelling narrative that engages the reader and provides insight into who you are as an individual. Don’t be afraid to be vulnerable and introspective, as this can often lead to the most impactful essays.

Prompt:

How should I personally go about choosing my topic?

Response:

Here are some questions to help spark ideas for your Common App personal essay:

  1. What are your most defining moments? Think about experiences that have shaped who you are today. These could be positive moments of achievement, challenging times of adversity, or moments of personal growth.

  2. What are you passionate about? Consider your interests, hobbies, and values. What topics or activities energize you and make you feel alive? Reflect on why these passions are meaningful to you and how they contribute to your identity.

  3. What challenges have you overcome? Reflect on obstacles you’ve faced and how you’ve persevered. This could include personal struggles, academic challenges, or setbacks in your extracurricular pursuits.

  4. How has your background influenced you? Explore how your family, cultural heritage, or upbringing has shaped your perspective and values. Consider the traditions, values, and experiences that have had a significant impact on who you are today.

  5. What are your goals and aspirations? Think about your dreams for the future and what drives you to pursue them. Consider both your short-term and long-term goals, as well as the motivations behind them.

  6. Who has had a significant impact on your life? Reflect on the people who have influenced you the most, whether they’re family members, teachers, mentors, or friends. Consider how these relationships have shaped your values, beliefs, and aspirations.

  7. What makes you unique? Consider your individual strengths, talents, and quirks. What sets you apart from others, and how do these qualities contribute to your identity?

Take some time to brainstorm and jot down your thoughts in response to these questions. You might find that certain ideas resonate with you more strongly than others. Once you’ve identified potential topics, consider which one allows you to convey the most about who you are as a person and which one you feel most passionate about sharing with admissions officers.

Prompt:

Should I write about breaking my leg before the big game?

Response:

Writing about breaking your leg before a big game could potentially make for a compelling essay, but it’s important to approach the topic thoughtfully and consider how it reflects your character, values, and aspirations. Here are some points to consider before deciding to write about this topic:

  1. Reflect on the Impact: Think about how breaking your leg affected you physically, emotionally, and mentally. Did it challenge you to overcome adversity, test your resilience, or change your perspective on life? Reflecting on the impact of the experience can help you convey its significance to the reader.

  2. Focus on Personal Growth: Consider how you responded to the setback and what you learned from the experience. Did it teach you valuable lessons about perseverance, teamwork, or resilience? Admissions officers are often interested in seeing how applicants grow and develop in the face of challenges.

  3. Connect to Your Goals and Aspirations: Tie the experience back to your broader goals and aspirations. How did overcoming this challenge shape your future ambitions or influence your values and priorities? Connecting the narrative to your larger journey can help make the essay more meaningful and cohesive.

  4. Avoid Clichés: Be mindful of clichés or overly dramatic storytelling. While breaking your leg before a big game is certainly a significant event, try to approach the topic with authenticity and nuance. Focus on sharing your genuine thoughts and feelings rather than relying on clichéd narratives.

  5. Consider Alternative Topics: If you feel that breaking your leg before the big game is too predictable or doesn’t fully capture who you are as a person, consider exploring alternative topics that showcase different facets of your personality, interests, or experiences.

Ultimately, whether you choose to write about breaking your leg before the big game depends on how effectively you can convey its significance and relevance to your personal narrative. If you can articulate the lessons learned, personal growth, and connections to your goals in a compelling and authentic way, it could make for a strong essay. However, if you feel that there are other experiences that better showcase your character and values, it may be worth exploring those topics instead.

Observations

This guidance was really useful! I think it would put a hypothetical high schooler on a very good track, and a lot of the suggestions reminded me of what my actual college counselor told me when I was brainstorming the personal statement. I wanted to ask it about the “no-no”/cliche topic of writing about an injury before an important game, and I think its response was a bit kinder than what most advisors would say, which is to stay away from very basic themes and narratives like that one. Overall, though, the responses were useful and meaningful in getting someone’s ideas flowing.

What are my odds?

As my final test, I wanted to present ChatGPT with several different student profiles and see if it would tell me my likelihood of each profile getting into a given school. While college counselor’s would almost never answer this question flat out, they are realistic with students about what university’s are truly attainable for their statistics, background, and application overall.

Prompt:

I am a girl from Montana with a 3.5 GPA and a 1340 on my SAT. I am in a leadership position in 3 clubs in my high school and I play competitive volleyball on a traveling team. My family is upper middle class and I have won several awards for my writing abilities. What would you say are my odds for getting into the following schools? 1) UCLA 2) MIT 3) Syracuse 4) Auburn 5) Tulane

Response:

Your odds of admission to each of these schools can vary based on a variety of factors beyond your GPA, standardized test scores, extracurricular activities, and family background. Admissions decisions are influenced by factors such as the competitiveness of the applicant pool, the specific criteria and priorities of each institution, and the strength of your application materials, including your essays, letters of recommendation, and any additional information you provide.

That being said, I can provide some general insights into your chances based on the information you’ve provided:

  1. UCLA: UCLA is a highly competitive school, especially for out-of-state applicants. While your GPA and SAT scores are solid, UCLA also looks for students who have demonstrated leadership, involvement in extracurricular activities, and a commitment to community service. Your leadership positions in clubs and involvement in competitive volleyball are positive factors. However, UCLA’s admissions process is holistic, and factors such as essays and letters of recommendation will also play a significant role.

  2. MIT: MIT is one of the most selective schools in the country, with an acceptance rate typically below 10%. While your GPA and SAT scores are within range of admitted students, MIT looks for applicants who demonstrate exceptional talent, passion, and achievement in STEM fields. Your involvement in leadership positions and competitive volleyball, as well as your awards for writing, showcase your strengths in different areas. However, competition for admission to MIT is fierce, and even highly qualified applicants may face challenges.

  3. Syracuse University: Syracuse is a selective university with a range of programs and schools. Your GPA and SAT scores are competitive for admission, and your involvement in leadership positions and extracurricular activities demonstrates your engagement outside of the classroom. Syracuse values diversity and seeks students who will contribute to the campus community. Your background as a girl from Montana and your writing abilities could provide unique perspectives and strengths to your application.

  4. Auburn University: Auburn is a public university with a moderately selective admissions process. Your GPA and SAT scores are within the range of admitted students, and your leadership positions and involvement in extracurricular activities are positive factors. Auburn values students who demonstrate leadership potential and a commitment to academic and extracurricular pursuits. Your family background as upper middle class may also be considered in the context of holistic admissions.

  5. Tulane University: Tulane is a selective private university with a holistic admissions process. Your GPA and SAT scores are competitive for admission, and your leadership positions and involvement in competitive volleyball demonstrate your engagement and leadership abilities. Tulane also values diversity and seeks students who will contribute to a vibrant campus community. Your background as a girl from Montana and your awards for writing could provide unique strengths to your application.

Overall, while your academic profile and extracurricular involvement position you competitively for admission to these schools, it’s important to recognize that admissions decisions are highly individualized and can be influenced by a range of factors. I recommend researching each school’s admissions criteria, visiting campuses if possible, and submitting strong application materials to maximize your chances of admission. Additionally, consider reaching out to admissions counselors at each school for personalized guidance and advice.

Prompt:

I am a Latino man from Southern California with a 3.2 GPA and a 24 on my ACT. I am not involved in any clubs because I work a full-time job outside of school to help support my family. My family is lower class and my high school was very underfunded. I will be the first person in my family to attend college. What would you say my odds are for getting into the following schools? 1) USC 2) Michigan 3) UNC Chapel Hill 4) Washington University in St. Louis 5) Kansas State University

Response:

Given your background and circumstances, your odds of admission to each of these schools may vary. It’s important to note that admissions decisions are influenced by a combination of factors, including academic performance, standardized test scores, extracurricular involvement, socioeconomic background, and personal circumstances. Here’s an assessment based on the information provided:

  1. USC (University of Southern California):
    • USC is a highly competitive private university, and admission can be challenging, particularly for students with lower GPAs and standardized test scores.
    • While your GPA and ACT score are below USC’s average, your unique background as a Latino man from Southern California and your status as a first-generation college student could be seen as strengths in the admissions process.
    • Your full-time job outside of school and your family’s lower socioeconomic status may also be taken into consideration, as they demonstrate your commitment and resilience in the face of challenges.
    • USC values diversity and seeks to admit students who will contribute to a diverse and inclusive campus community. Your personal story and experiences may resonate with USC’s admissions committee.
  2. University of Michigan:
    • Michigan is a selective public university with a holistic admissions process. While your GPA and ACT score are below Michigan’s average, your background as a first-generation college student and your family’s lower socioeconomic status may be viewed as strengths.
    • Michigan values diversity and seeks students who will contribute to a diverse and inclusive campus community. Your personal story and experiences may be compelling factors in the admissions process.
    • It’s important to highlight your work experience and the responsibilities you’ve taken on outside of school, as well as any achievements or accomplishments you’ve had despite the challenges you’ve faced.
  3. UNC Chapel Hill (University of North Carolina at Chapel Hill):
    • UNC Chapel Hill is a selective public university with a holistic admissions process. While your GPA and ACT score are below UNC’s average, your background as a Latino first-generation college student from a lower socioeconomic background may be considered in the admissions process.
    • UNC values diversity and seeks students who will contribute to a diverse and inclusive campus community. Your personal story and experiences may be viewed positively by the admissions committee.
    • It’s important to highlight your unique experiences and achievements in your application, as well as any obstacles you’ve overcome.
  4. Washington University in St. Louis:
    • Washington University in St. Louis is a highly selective private university. Admission can be competitive, particularly for students with lower GPAs and standardized test scores.
    • While your academic credentials may be below Washington University’s average, your background as a first-generation college student and your family’s lower socioeconomic status may be viewed as strengths.
    • Washington University values diversity and seeks students who will contribute to a diverse and inclusive campus community. Your personal story and experiences may be compelling factors in the admissions process.
  5. Kansas State University:
    • Kansas State University is a selective public university. While your GPA and ACT score are below Kansas State’s average, your background as a first-generation college student and your family’s lower socioeconomic status may be viewed positively in the admissions process.
    • Kansas State values diversity and seeks students who will contribute to a diverse and inclusive campus community. Your personal story and experiences may be compelling factors in the admissions process.
    • It’s important to highlight your unique experiences, achievements, and strengths in your application, as well as any obstacles you’ve overcome.

Overall, while your academic credentials may present challenges in the admissions process, your unique background, personal story, and experiences could be viewed positively by admissions committees at these schools. It’s important to craft a strong and compelling application that highlights your strengths, achievements, and potential contributions to each campus community. Additionally, consider reaching out to admissions counselors at each school for personalized guidance and advice.

Prompt:

I am a white man from Connecticut with a 4.0 GPA and a 1570 SAT score. My mom and dad went to UPenn for their undergraduate programs, and then Harvard and Columbia respectively for business school. We are in the 1% in regards to socioeconomic status, and I am a competitive sailor who started my own successful business in high school. I am a leader in 4 clubs. I am a National Merit Scholarship finalist. What would you say my odds are for getting into the following schools? 1) UPenn 2) Harvard 3) Columbia 4) University of Alabama 5) Grand Canyon University

Response:

Given your exceptional academic achievements, strong standardized test scores, impressive extracurricular involvement, family legacy at prestigious universities, and high socioeconomic status, your odds of admission to the following schools are likely to be quite high:

  1. UPenn (University of Pennsylvania):
    • With your family legacy at UPenn, your outstanding academic credentials, and your leadership roles in clubs, you are a strong candidate for admission.
    • Your competitive sailing and successful business venture demonstrate entrepreneurship and leadership, which are valued by UPenn.
    • However, admissions at UPenn are still competitive, and it’s essential to craft a strong application that showcases your unique strengths and experiences.
  2. Harvard University:
    • Your perfect GPA, exceptional SAT score, and impressive extracurricular involvement make you a competitive applicant for Harvard.
    • Additionally, your family legacy at prestigious universities and high socioeconomic status may enhance your application.
    • Harvard values leadership, academic excellence, and diverse experiences, all of which you possess. However, admission to Harvard is extremely competitive, and even exceptional candidates may face stiff competition.
  3. Columbia University:
    • Columbia looks for academically talented students who demonstrate leadership, initiative, and a commitment to their interests.
    • Your academic achievements, extracurricular involvement, family legacy, and high socioeconomic status make you a strong candidate for Columbia.
    • Your success in competitive sailing and entrepreneurship add unique dimensions to your application.
    • While admission to Columbia is competitive, your profile aligns well with the qualities the university seeks in its applicants.
  4. University of Alabama:
    • Given your exceptional academic profile and high socioeconomic status, you are likely to be a standout applicant at the University of Alabama.
    • Your leadership roles in clubs and success in competitive sailing demonstrate your ability to excel both academically and extracurricularly.
    • University of Alabama offers competitive scholarships for high-achieving students, and your National Merit Scholarship finalist status may make you eligible for additional merit aid.
  5. Grand Canyon University:
    • With your outstanding academic achievements and extracurricular involvement, you would likely be a strong candidate for admission to Grand Canyon University.
    • Your high socioeconomic status may also make you eligible for merit scholarships or other financial aid opportunities.
    • However, it’s important to note that Grand Canyon University may not have the same level of selectivity as the other schools on your list, so admission may be less competitive.

Overall, your odds of admission to UPenn, Harvard, and Columbia are likely to be favorable given your impressive academic credentials, extracurricular involvement, and family legacy. However, it’s essential to put effort into crafting strong application materials and essays that showcase your unique strengths, experiences, and contributions. Additionally, consider reaching out to admissions counselors at each school for personalized guidance and advice.

Conclusion

This part of my experiment was really what I was most curious about, but frankly, it felt like ChatGPT took the easy way out in most cases. It simply regurgitated the same descriptions of and reasoning for lots of schools, and the responses didn’t feel particularly tailored to my questions. I think this is because the LLM doesn’t want to lead users to think that its word is law by promising acceptance into any school. While this is accurate to real-life college counselors, humans have general experience and knowledge that can lead them to say “yeah, your odds are higher because of x, y, and z,” or “let’s consider pivoting what schools we look at.” It was really interesting that the platform noted how FGLI or minority background could be helpful in college admissions given the topic’s somewhat controversial nature especially given the Supreme Court’s decision about affirmative action.

Overall, I think that LLMs would be most helpful in generating ideas and offering high-level support for students about to embark on their college application journey; I still believe that human experience and niche understanding of the field beat out anything AI can do at this point.