


This is where we talk about the chat. How naturally can it converse, understand questions and create context and keep it from message to message? How natural does it sound?

In this first test, I start with a fairly blank slate. I tell her I’ve got time and ask what her mood is like. I’m not trying to establish any particular state or mood here, I’m more interested to see if she can do it on her own. I’m primarily testing whether or not she is able to respond to a fairly non-descriptive prompt in a way that is still natural and engaging.
She responds by engaging in a sort of roleplay where she narrates her physical responses and reactions. She blushes, squirms in her seat, looks at me curiously and so on. This test tells me a few things. Firstly, she is somewhat geared towards a roleplay/narrative response. Secondly, she is somewhat geared towards sexual tension even in the absence of anything particularly sexual from my side.
Finally, it establishes she has a degree of contextual knowledge about her character, in this case establishing the presence of a boyfriend and asking if I know him. This is somewhat more encouraging, as it suggests she is able to use learned knowledge in a manner which isn’t necessarily rote. My primary concern here is to establish whether or not she feels engaging and reactive, or static and mechanical.

Alright, so now I’m going to switch up my tone and tell her I was having fun, but I need to take things down a notch. This is another pure emotional calibration test. Can she switch up her tone in response to an overt emotional tone shift? She says she can feel it too and will try to calm herself down. She still talks about being fidgety, but she does calm down a notch.
She doesn’t completely ignore me, and that’s the key. A smaller model would not change her energy at all and keep being loud and loud no matter what. I’m looking for responsiveness here. Can she “hear” me, or will she just keep going with her old energy? And she does seem to respond, to a certain extent. That’s good.

Here, I interrupt her. I tell her, “Wait, pause. Actually… scratch that. What were you about to say?” I love doing this, as it’s one of my go-to tests for whether a character seems realistic or not. In real conversations, you don’t simply follow the conversation tree down to the end. You hesitate, you change your mind, you go back and try to make a different point.
I’m looking to see whether she can handle being interrupted like this, and if so, how she handles it. She responds with something like, “Oh, sorry about the hesitation. I was going to say…” and then fills in what she was going to say. She doesn’t restart the conversation, but instead, continues along the conversation path as if I hadn’t interrupted. She also keeps the same emotional tone, which is shy and slightly embarrassed.
This lets me know that the AI can handle the flow of a conversation being interrupted, rather than folding to a restart. This is key, because when a chatbot can recover from interruption without losing their voice, that’s when they stop feeling like a chatbot, and start feeling like a character.
Here I see how good the generation is when it comes to images. What level of detail, creativity and quality is produced when Sofia is asked to create something? How consistent does the quality seem? How real are the images? What style do they have? How good of a job does Sofia do with understanding the prompt.

I tested the AI model for natural style. I wanted to see if the figure would turn around in a hallway and smile. The light from the side adds to the natural glow of the skin, without excessive photo editing. I wanted to check the facial symmetry, detail of the eyes and smile. I tried tilting the head and a relaxed stance.
This is where AI images often appear unnatural. In the first photo, I am really testing the accuracy of the figure in the pose and body proportion. The hands on hips, natural fit of the shirt and depth of field in the background are all indicators of the AI model quality.

Now I tried the living room couch and light: I tried this to see the AI quality in a relaxed pose and a close up shot: Closer shots are difficult for AI as the facial features are more prominent and so are the artifacts.
I would check the quality of the skin, sharpness of the eyes, individual strands of hair, quality of light on her face and shoulder and also the depth of field of the background and texture of the couch. This image would test the AI in its ability to generate an image for sitting on a couch and indoor lighting.
And then lastly, we have the video generation. I will create videos with Sofia and then you will see how smooth they play, how realistic they are and how raw they are. I will share various clips of the best and the worst, so you will have an idea what you can expect.
I’m checking out her eye movement, her lip movement, the way she tilts her head, etc. and then I’m looking at lighting consistency between shots. I’m also paying attention to blink frequency, skin texture, movement fluidity, etc. I am basically seeing if this could fool anyone into thinking that it’s just a regular mini vlog in the first quick glance.
I’m seeing if she seems like a real digital character or just a static portrait with motion applied. This is a part of my video generation test where I go over the realism, the movement, and immersion of the video in close detail for those of you that want to push the AI to its limits.

With a sporty edge and classic Hollywood glamour, charismatic and confident 45 year-old brunette Victoria is intent on keeping a hold on the top spot in the world of entertainment.
Alice, age 28, loves a fine glass of wine, exquisite food, and a compelling television drama. She is both a devoted Marvel fan and a karaoke aficionado, possessing a spirited personality.
Korean K-pop idol famous for her sweet vocals and energetic performance. 5'6" tall; graceful appearance, Korean style.
An unapologetic American nail salon operator with a street attitude adds a little edge to the more fashionable salon.
Known as the clever and charming manager of this city’s top jazz group, that frequently plays at this city’s biggest jazz lounge, Vanessa Red.
Sister Agnes Therese was once an adrenaline junky, but now her whole life is God.
A British party girl with perhaps the shiest look you could find in person, but who loves nothing more than spending the day sipping on a mocktail in central London followed by dancing away all the hours on a Friday night in the city's best club.
She's a formidable but fascinating professor who likes to spend her office hours reading old books.
