What does it take to create a video using AI tools as much as possible? The following is our journey making this 5-minute video, “MUSE.”
We had two cover songs.
Ciara – Paint It, Black
And Nik West- BACK IN BLACK (AC/DC cover)
The “MUSE” screenplay was written by ChatGPT AI based on the lyrics from “Paint it, Black” by the Rolling Stones and “Back in Black” by AC/DC.
We told ChatGPT AI the following:
Please psychoanalyze these two song lyrics: “Paint it, Black” by the Rolling Stones and “Back in Black” by AC/DC and if they have a common theme.
Paint It, Black Lyrics
[Verse 1]
I see a red door and I want it painted black
No colours anymore, I want them to turn black
I see the girls walk by dressed in their summer clothes
I have to turn my head until my darkness goes
[Verse 2]
I see a line of cars and they’re all painted black
With flowers and my love, both never to come back
I see people turn their heads and quickly look away
Like a newborn baby, it just happens every day
[Verse 3]
I look inside myself and see my heart is black
I see my red door, I must have it painted black
Maybe then I’ll fade away and not have to face the facts
It’s not easy facing up when your whole world is black
[Verse 4]
No more will my green sea go turn a deeper blue
I could not foresee this thing happening to you
If I look hard enough into the setting sun
My love will laugh with me before the morning comes
[Verse 1]
I see a red door and I want it painted black
No colours anymore, I want them to turn black
I see the girls walk by dressed in their summer clothes
I have to turn my head until my darkness goes
[Outro]
I wanna see your face, painted black
Black as night, black as coal
I wanna see the sun blotted out from the sky
I wanna see it painted, painted, painted, painted black
Yeah
“Paint It, Black” by the Rolling Stones:
This song, released in 1966, is generally interpreted as reflecting themes of depression, despair, and emotional turmoil. The lyrics describe the narrator’s desire to remove all color from the world, turning everything black to match their inner state. This is evident in lines like “I see a red door and I want it painted black” and “I see the girls walk by dressed in their summer clothes / I have to turn my head until my darkness goes.”
The song also touches on themes of loss and grief, as the narrator sees a line of cars painted black with flowers and love, both never to come back. This could be a reference to a funeral procession or the idea of losing someone dear. The narrator struggles with facing the reality of their emotions, stating “It’s not easy facing up when your whole world is black.”
Back in Black Lyrics:
[Verse 1]
Back in black, I hit the sack
I’ve been too long, I’m glad to be back
Yes, I’m let loose from the noose
That’s kept me hanging about
I’ve been looking at the sky cause it’s getting me high
Forget the hearse, cause I never die
I got nine lives, cat’s eyes
Using every one of them and running wild
[Verse 2]
Back in the back of a Cadillac
Number one with a bullet, I’m a power pack
Yes, I’m in a bang with a gang
They’ve got to catch me if they want me to hang
Cause I’m back on the track and I’m beating the flack
Nobody’s gonna get me on another rap
So look at me now, I’m just making my play
Don’t try to push your luck, just get out of my way
“Back in Black” by AC/DC:
“Back in Black,” released in 1980, has a completely different tone than “Paint It, Black.” This song is a celebration of life, resilience, and coming back stronger than before. The lyrics, “Back in black, I hit the sack / I’ve been too long, I’m glad to be back,” indicate a triumphant return after a period of absence or hardship.
The narrator asserts their strength and defiance, as seen in lines like “Forget the hearse, cause I never die” and “Nobody’s gonna get me on another rap.” The phrase “back in black” can symbolize a renewed sense of power and energy, as black is often associated with strength and intensity.
COMMON THEME
While both songs mention “black” prominently in their titles and lyrics, the themes are quite different. “Paint It, Black” deals with depression, despair, and loss, while “Back in Black” focuses on resilience, strength, and a celebration of life. The common thread between the two songs is the exploration of the human experience and emotions, but they each present a contrasting perspective on dealing with challenges and emotions.
To AI: Please create a log line for a movie premise based on the first part being about “Paint It, Black” and dealing with depression, despair, and loss. And at the end, use “Back in Black” focusing on resilience, strength, and a celebration of life.
After losing the love of his life, a grief-stricken artist turns his world black as he spirals into depression and despair, only to rediscover his inner strength and resilience through an unexpected bond, leading him to embrace life’s vibrant colors and celebrate the power of hope and transformation.
We have rewritten the log line as follows: After a loss of identity, a grief-stricken artist turns his world black as he spirals into depression and despair, only to rediscover his inner strength and resilience through an unexpected bond, leading him to embrace life’s vibrant colors and celebrate the power of hope and transformation.
Please take this new log line and create screenplay with some dialog.
Title: Colors of Hope
INT. ARTIST’S STUDIO – DAY
The walls are covered in black and gray paintings. The room is dimly lit. Our protagonist, JAMES (30s, disheveled), sits on a stool, staring blankly at an unfinished black canvas.
INT. ART GALLERY – DAY
James’ best friend, LUCY (30s, supportive), walks with him through an exhibit filled with colorful paintings.
LUCY
You know, you used to paint like this. Full of life and color.
JAMES
(sighs)
That was a different time, Lucy. Things have changed.
INT. ARTIST’S STUDIO – NIGHT
James wakes up to a loud knock on the door. He opens it to find an ENERGETIC WOMAN (20s, enthusiastic), standing on his doorstep.
ENERGETIC WOMAN
Hi, I’m Mia! I just moved in next door, and I couldn’t help but notice your amazing artwork. May I come in?
INT. ARTIST’S STUDIO – DAY
Mia and James spend time together, laughing and painting. She encourages him to experiment with brighter colors.
MIA
You have so much talent, James. Don’t let your past define you. Embrace the colors of life.
James hesitates, then slowly picks up a brush and dips it into a bright red paint.
INT. ART GALLERY – NIGHT
James stands next to his new painting, full of vibrant colors, at the opening of his exhibition. He addresses a small crowd, with Lucy and Mia smiling at his side.
JAMES
I’ve been lost for a long time. But with the help of some incredible people, I found the strength to embrace the colors of life. This exhibition is a celebration of hope, transformation, and new beginnings.
The crowd applauds, and James shares a grateful look with Lucy and Mia.
FADE OUT.
THE END
Please make the following changes:
REMOVE the character of Lucy.
Have James the artist discover (from Mia suggestion) that adding color to his black painting creates a beautiful high contrast. He doesn’t return to only colored painting but combines color with the dark for higher vibrancy and energy.
Have Mia and James meet at the gallery and go back to his studio to see his paintings. She doesn’t knock on his door.
Title: Colors of Hope
INT. ART GALLERY – DAY
The walls are covered with colorful paintings. Our protagonist, JAMES (30s, disheveled), walks alone through the exhibit, reminiscing about the time when he used to paint with vibrant colors.
An ENERGETIC WOMAN, MIA (20s, enthusiastic), approaches James.
MIA
Hi, I couldn’t help but overhear that you’re an artist too. I’m Mia, and I’d love to see your work.
JAMES
(smiles hesitantly)
Sure, why not. My studio is just around the corner.
INT. ARTIST’S STUDIO – DAY
James shows Mia around his studio filled with black and gray paintings. She studies his artwork thoughtfully.
MIA
You have so much talent, James. Have you ever tried combining your dark paintings with bright colors? The contrast could be stunning.
James hesitates, then slowly picks up a brush and dips it into a bright red paint. He adds a few strokes to his black canvas, creating a striking high-contrast piece.
INT. ART GALLERY – NIGHT
James stands next to his new painting, full of vibrant colors against a dark background, at the opening of his exhibition. He addresses a small crowd, with Mia smiling at his side.
JAMES
I’ve been lost for a long time. But with the help of an incredible person, I found the strength to embrace the colors of life in a new way. This exhibition is a celebration of hope, transformation, and the power of contrast.
The crowd applauds, and James shares a grateful look with Mia.
FADE OUT.
THE END
This below is our human rewrite of what you have written. Please make suggestions that would make it even more cinematic.
TITLE: MUSE
INT. ARTIST’S STUDIO – DAY
The walls are covered in black and gray paintings. The room is dimly lit. Our protagonist, JAMES (30s, disheveled), sits on a stool, staring blankly at an unfinished black canvas.
INT. ART GALLERY – DAY
The Art Gallery is brightly lit and vibrant. The walls are covered with colorful paintings. Our protagonist, JAMES (30s, disheveled), walks alone through the exhibit, reminiscing about the time when he used to paint with vibrant colors. He hears the bell ring as someone enters the Art Gallery. he turns.
MIA (20s, enthusiastic), sticks her head in the door.
MIA
Hi, are you open?
JAMES
uh, Yeah. We’re open.
Mia enters the Art Gallery.
MIA
I wasn’t sure. I’m Mia, are you the artist? James?
JAMES
(Laughs)Yeah, I’m James. I used to be the artist.
MIA
But not anymore?
JAMES
No. But you’re welcome to take a look. Let me know if you want to buy anything.
Mia looks at some of the pieces on the wall.
MIA
I’m actually an artist myself.
JAMES
So you want to sell here then?
MIA
Maybe, are you into that sort of thing?
JAMES
I could be. I haven’t exactly been producing the prettiest of art recently. It could be good for business to get new paintings in here.
MIA
That can’t be true. Look at these. Your art is beautiful.
James walks over to look at the same painting as her. It’s a painting of a red door.
JAMES
It was. Now whatever I see, I want to paint it black. It doesn’t turn any profit.
MIA
Could I judge for myself? I’d love to see your current work.
A beat.
JAMES
(smiles hesitantly)
Sure, why not. My studio is just around the corner.
INT. ARTIST’S STUDIO – DAY
James shows Mia around his studio filled with black and gray paintings. She studies his artwork thoughtfully.
JAMES
Don’t mind the clutter.
MIA
You have so much talent, James. I see the beautiful darkness. Why don’t you like it?
JAMES (puts a hand to his heart)
There’s something missing.
MIA
Like color?
JAMES
Like color… emotion.
Mia opens one of his paint jars and sets a paintbrush in it then steps back. Silence. James steps forward. He hesitates, then slowly picks up the brush covered in orangish-yellow paint. He adds a few strokes to his black canvas, creating a striking high-contrast piece. As his paintbrush touches the canvas BACK IN BLACK by ACDC blares as if in his and Mia’s heads. He looks to her with a look of excitement.
MIA
Not bad. Was that fun?
JAMES
You wanna try?
MIA
And ruin your painting?
JAMES
You can try, but I can only see it going up from here.
Mia puts a brush to the canvas. Now she’s back in black. The guitars roar. James shares a grateful look with Mia. They both start painting again. Montage of them putting cats eyes, Cadillacs, a hearse, a broken noose, and a bullet with the number one on it onto the painting. When they’re done they have a crazy collage.
MIA
Looks like you’re back.
JAMES
Thank you for your help.
MIA
Anytime.
Mia disappears in a puff of inky black clouds and James realizes she was a Muse the whole time.
FADE OUT.
THE END
ChatGPT AI comments: Your rewrite adds a more conversational and playful tone to the story, which contributes to the cinematic experience. Here are some suggestions to make it even more cinematic:
Consider using more descriptive language to set the mood and environment for each scene. This will help create a vivid picture in the reader’s mind.
INT. ART GALLERY – DAY
The Art Gallery is bathed in warm, natural light, with sunlight streaming through large windows. The vibrant colors of the paintings contrast with James’ disheveled appearance.
Incorporate more visual cues and actions into the dialogue, revealing the characters’ emotions and thoughts without explicitly stating them.
As James reluctantly agrees to show Mia his studio, he runs a hand through his unkempt hair, revealing his vulnerability.
Introduce more dynamic camera angles and movements to enhance the cinematic feel.
EXT. CITY STREET – DAY
As James leads Mia to his studio, the CAMERA follows them from a low angle, emphasizing the contrast between the gloomy streets and the bright sky above.
You may want to emphasize the turning point in the story by creating a visually striking moment when James and Mia start painting together.
INT. ARTIST’S STUDIO – DAY
As James and Mia’s brushes touch the canvas, a sudden burst of color fills the room, with vibrant hues of paint splattering onto the once-dark walls. The energy and excitement in the air are palpable.
Finally, consider extending the montage to show James and Mia’s growing bond and the transformation of James’ art.
MONTAGE – VARIOUS
James and Mia paint together, laughing and enjoying each other’s company The once-dark studio gradually fills with colorful paintings James’ appearance and demeanor change, reflecting his newfound hope and inspiration The final scene in the gallery exhibits James’ new high-contrast, vibrant artworks, demonstrating his growth as an artist.
ChatGPT AI comments: With these suggestions, you.r screenplay will have an even more cinematic and engaging feel, capturing the essence of the characters’ emotional journey.
VOICE
We converted to screenplay to dialog only in an offline text editor. Then the male and female voices were generated with ElevenLabs Voice AI. The voices used were Josh (male) and Elli (female). Elli’s voice was modified using their customization features.
https://creativexplosion.art/wp-content/uploads/2023/03/synthesized_audio-JAMES-1.mp3
The voice was cut into dialog pieces and reconstructed in sequence on two separate tracks in Kdenlive, open-source video editor. The male track was boosted by 8dB and the female track by 9dB.
Music
Ciara, cover of “Paint It, Black” and Nik West, cover of “Back in Black,” were both downloaded as MP3 files. We used Y2Mate, Youtube Downloader tool, to convert and download the audio for free. We then checked quality in Audacity open-source audio editor. We corrected clipping errors with the compression filter.
Stems
The music stems were split by LALAL.AI online. LALAL.AI is a vocal remover and music source separation subscription service. That allowed us to separate and modify the voice and instrumental tracks. We wanted to fade out the vocal track and have the music track continue. We also extracted three introductory notes from a downloaded “Back in Black” piano cover using Audacity.MUSIC
MUSIC DRONES
Two atmospheric drone tracks (also called ambient pads) were downloaded from YouTube using an MP3 downloader. One in E flat minor and another in E major. These matched the keys of the two songs. The key was identified with https://tunebat.com/Analyzer. This tool uploads your audio files to find the key and tempo of the tracks in your library. This is a tool is useful for harmonic remixing songs.
VIDEO CLIP
We added this as an overlay to the video.
Because the lightening bolt was a silent video, we download mp3 noises & sound effects (sfx) for free at https://www.salamisound.com/5033096-first-lightning-thunder-of-a. This appears at 2:23 minutes.
MOTION
The “Red Door” motion video clip was created using PhotoFilmStrip open-source software. PhotoFilmStrip creates movies out of still pictures in just 3 steps. This is called a parallax effect, (or Ken Burns effect, named after the filmmaker). It involves panning and/or zooming on a still image to give the effect of motion or animation, like in a video. The images of red doors in black rooms were created using Midjourney AI and then processed with PhotoFilmStrip. The clip is used twice with a transparency on the second usage at 2:05 minutes.
MIDJOURNEY AI PROMPT GENERATION
ChatGPT suggested 75 AI prompts for Midjourney AI to generate over 100 final images based on the lyrics and screenplay. We didn’t use all the prompts but cherry-picked appropriate ones. The style is dry brush painting.
STYLE: Drybrush painting styles with brush strokes
SETTING: NEW YORK CITY
Suggest 25 AI prompt for MIdjourney images based on the lyrics of “Paint It, Black”
- A red door in a desolate landscape, ready to be painted black.
- A row of cars painted black, with a single bright flower on the hood.
- A figure walking with their head down, avoiding eye contact with others.
- A dark, stormy sky above a barren landscape, with the sun barely visible through the clouds.
- A person standing in front of a mirror, staring at their blackened heart.
- A black paintbrush hovering over a colorful canvas, ready to change its hues.
- A person walking away from a dark past, determined to face the facts.
- A green sea transitioning into a deeper blue, representing emotional turmoil.
- A setting sun casting a shadow on a blackened heart, symbolizing hope.
- A person laughing in the face of darkness, as the morning sun rises.
- A person walking through a monochrome world, searching for color and hope.
- A figure standing at a crossroads, contemplating their choices and future.
- A vibrant sunset breaking through the darkness, symbolizing a change in perspective.
- A person painting a once-colorful world black, consumed by despair.
- A figure on a journey, leaving behind a trail of black paint as they walk.
- A solitary person in a dark room, surrounded by blackened canvases.
- A figure standing at the edge of a cliff, looking out at a blackened sea.
- A person turning away from a bleak world, seeking solace in their memories.
- A black paintbrush dripping paint onto a colorful floor, leaving a trail of darkness.
- A person painting black over a once-colorful mural, symbolizing loss and change.
- A heart encased in darkness, desperate for a glimmer of light.
- A figure standing on a bridge, looking down at a river of black paint.
- A person trapped in a blackened room, searching for a way out.
- A black sun setting over a desolate landscape, casting long shadows on the ground.
- A figure holding a black paintbrush, hesitating to change the colors of their world.
Suggest 25 AI prompt for MIdjourney images based on the lyrics of “Back in Black”
- A figure rising from the shadows, triumphant and full of energy.
- A person breaking free from chains, symbolizing newfound strength and resilience.
- A silhouette dancing against a backdrop of bright lights, celebrating life.
- A figure emerging from a dark tunnel, entering a world filled with color and vitality.
- A person climbing a mountain, reaching the peak with determination and persistence.
- A powerful wave crashing against a shore, symbolizing the unstoppable force of life.
- A figure running through a field, leaving a trail of vibrant colors in their wake.
- A person strumming an electric guitar, creating a visual explosion of sound and energy.
- A silhouette standing on a rooftop, arms outstretched, embracing the world around them.
- A figure stepping out of a black-and-white world into a vibrant, colorful landscape.
- A person surrounded by a whirlwind of colors, representing their transformation and growth.
- A figure painting a wall black, only to have colorful flowers bloom from the darkness.
- A person dancing in the rain, celebrating life amidst the storm.
- A figure leaping across a chasm, overcoming obstacles and challenges.
- A phoenix rising from the ashes, symbolizing rebirth and renewed strength.
- A person standing at the edge of a cliff, ready to take a leap of faith into a colorful abyss.
- A figure with outstretched arms, catching rays of light as they break through the darkness.
- A person navigating a maze, guided by a bright light at the end of the path.
- A figure painting a black canvas with bright, bold strokes, reclaiming their identity and power.
- A person standing in a field of blackened flowers, as a single vibrant bloom springs to life.
- A figure casting off a dark cloak, revealing a bright and colorful outfit underneath.
- A person walking away from a crumbling black wall, moving towards a brighter future.
- A figure standing in a spotlight, basking in the warmth and energy of the light.
- A person breaking through a barrier, representing their perseverance and determination.
- A figure rising like a balloon, leaving the darkness behind and soaring towards a vibrant sky.
Suggest 25 AI prompt for MIdjourney images based on our screenplay:
- A close-up of James’ face as he intensely stares at the black canvas, reflecting his inner turmoil.
- A shot of the crescent moon through the open window, symbolizing the darkness that has enveloped James’ life.
- A vibrant art gallery filled with colorful paintings, contrasting with James’ dark mindset.
- Mia entering the gallery, her enthusiasm and energy a stark contrast to James’ disheveled appearance.
- A painting of a red door, representing James’ past as a vibrant and successful artist.
- A moment of hesitation as James picks up a paintbrush, ready to add color to his black canvas.
- James and Mia painting together, their collaborative energy bringing life to the dark studio.
- A montage of various objects being painted onto the canvas, symbolizing James’ journey back to embracing color and life.
- James and Mia sharing a grateful look, acknowledging the transformation that has taken place.
- The studio gradually filling with colorful paintings, representing James’ newfound hope and inspiration.
- A shot of James’ appearance and demeanor changing, reflecting his growth as an artist.
- A final scene in the gallery exhibiting James’ new high-contrast, vibrant artworks.
- Mia disappearing in a puff of inky black clouds, revealing her true nature as a muse.
- A close-up of James’ wide-eyed and dumbfounded expression as he realizes Mia was a muse.
- The title card “MUSE” appearing on the screen, symbolizing the theme of the screenplay.
- A shot of Mia playfully observing James’ artwork, her presence sparking creativity and change.
- James standing in his transformed studio, surrounded by his new vibrant artworks.
- A close-up of the orangish-yellow paintbrush, symbolizing the first step in James’ transformation.
- A shot of James and Mia laughing together as they paint, their shared joy infusing the studio with new energy.
- A time-lapse sequence of the black and gray paintings in the studio being replaced with colorful, high-contrast pieces.
- A close-up of James’ hand as he adds the final touch to one of his vibrant new paintings.
- A shot of the gallery visitors admiring James’ new artwork, recognizing his growth and artistic evolution.
- A wide shot of the once-dark studio, now filled with light and color, symbolizing James’ internal transformation.
- A close-up of Mia’s mischievous smile as she prepares to disappear, leaving her mark on James’ life.
- A final shot of James standing in his transformed studio, a look of wonder and gratitude on his face, as he embraces his new artistic journey.
All 75 prompts were run and produced 4 thumbnail images. From those were selected the ones to upsize. Upsizing in Discord takes approximately 3 minutes per image. We bulk downloaded all finals as a zip folder from Midjourney.
Final prompts were similar to the following example:
Drybrush painting style with brush strokes, David Gandy and Thylane Blondeau with curly hair, yellow raincoat long coat with buttons, in dark apartment, black and gray abstract paintings clutter the walls and floor, –ar 16:9
FINAL POOL OF 138 IMAGE CANDIDATES FROM 300 raw images.
These selected images took about 7 hours to render. Not all candidates were used in the final cut. That is 7 hours babysitting and button pushing. Fortunately we could work on other tasks during this process. The Discord notification bell cued us when to upsize new images.
- 7 black paintings
- 15 black & white
- 4 cityscape
- 26 color paintings
- 8 colors
- 9 girl
- 7 girl at door
- 30 guy
- 20 guy and girl
- 5 red door
- 3 studio
- 4 sunset
CHARACTERS
To get a semblance of character continuity, we used two popular male and female models names in the prompts, David Gandy and Thylane Blondeau.
David James Gandy (born 19 February 1980) is an English male fashion model who began his career after winning a televised model-search competition.
Thylane Léna-Rose Loubry Blondeau is a female French model (born 5 April 2001).
The final cut was assembled in Kdenlive opens-source video editor.
Jump cuts were synchronized to the clapping sounds and main bests.
Black space was used to emphasize music and mood changes.
The sound track was reprocessed in Audacity to compress clipping and then added back to the Kdenlive source.
Render time as MP4: under 5 minutes. Final uploaded to Vimeo and Instagram.
Below is the screen recording of the final Kdenlive control panel.
Titles and credits were added in Kdenlive using BigNoodleTitling, a freeware font.
You can get the component count in Kdenlive by following these steps:
- Open your Kdenlive project.
- In the Project tree, select the top-level folder that contains all the clips and sequences for your video.
- Right-click on the folder and select “Properties” from the context menu.
- In the Properties dialog box, you will see the Component Count listed under the “General” tab.
The Component Count tells you the total number of clips, sequences, and other elements that make up your video production. This can be a useful metric for tracking the complexity of your project and for estimating the amount of time and effort required to complete it.
The Project Tree is the panel in Kdenlive that shows the organization of your video project. You can find it in the top-left corner of the Kdenlive interface by default.
If the Project Tree is not visible in your Kdenlive workspace, you can enable it by going to the “View” menu and selecting “Project Tree” or by using the keyboard shortcut “Ctrl+1” (or “Cmd+1” on Mac). This will show the Project Tree panel on the left side of the Kdenlive window, where you can browse and manage your project’s files and folders.
76 clips were used in this production of “MUSE.”
The video production time wasn’t days, months, or years. It took only hours.
Special thanks to Levi Teare for final cut.
LEVI’S COMMENTS
Paint it Black was the first song in the short to help the audience get in the main characters headspace. He’s in a slump. His situational depression is shown in the montage at the beginning that coincides with Paint It Black. In the first draft, the images alternated between bright and colorful images and the darker, black and white images. The message wasn’t totally clear. To help clarify the mood, we transitioned those bright images to de-saturated versions of themselves on the beat.
Another change, I suggested was to remove a portion of the dialogue. In the original script it made sense, but the AI was generating images that didn’t exactly match the story of the original script. Rather than bashing the keyboard in frustration, we adapted the story to match. We took out the confusing dialogue that felt contrary to what was happening on screen and the story became clearer.
Lastly, when the main character is getting his mojo back, I thought it was fitting to add the piano motif of Back In Black to foreshadow his success and to hint at what was going on inside his head. I helped align the audio so that right after the Muse says “Looks like you’re back” the guitar comes in for the full Back In Black montage.
