I think I wrote about this. If I didn’t I am now. Part of the CWT is to enhance content with the writer or creator’s surroundings. It would be cool to be able to zoom away from the content itself and put yourself in the creator’s shoes. Where were they when they sketched the idea. Or wrote the thing. Or made the music. Etc. This does that:
An engine that lets you send your content to it, send your thoughts about what to do with the content, and have it recommend some prompts or choices based on the content type? Some fine tuning would be good for this. Some analysis of content types specific to Spoke would make it develop posts similar to other Spoke’s style. However, it could choose from a list of prompts like SK does.
Challenge
So then a challenge is to build up the prompts. Build up the skills. And let your program access those in a simple way.
Promise
Embedding this service into Spoke or another application. Return ideas or options to user on the fly. Could spawn a worker AI container/spark/etc. to make it happen.
At some level, I want a simple AI machine that I can whisper things to and let it store that for me. So that later on I can possibly retrieve the info in some connected way.
ShortGPT is a powerful framework for automating content creation. It simplifies video creation, footage sourcing, voiceover synthesis, and editing tasks.
🎞️ Automated editing framework: Streamlines the video creation process with an LLM oriented video editing language.
📃 Scripts and Prompts: Provides ready-to-use scripts and prompts for various LLM automated editing processes.
🗣️ Voiceover / Content Creation: Supports multiple languages including English 🇺🇸, Spanish 🇪🇸, Arabic 🇦🇪, French 🇫🇷, Polish 🇵🇱, German 🇩🇪, Italian 🇮🇹, and Portuguese 🇵🇹.
🔗 Caption Generation: Automates the generation of video captions.
🌐🎥 Asset Sourcing: Sources images and video footage from the internet, connecting with the web and Pexels API as necessary.
🧠 Memory and persistency: Ensures long-term persistency of automated editing variables with TinyDB.
Ship posts and rewrite in style of journalist, author, etc. practice and reading will increase. Grammar and skill will increase, as if mentoring alongside a master. Project: fine tune on editing dataset. Partner with a book or manuscript or other type of business for datasets and editing datasets. Would become a finely tuned small model that performs locally and cheaply. I think there are already sites that do this.
Blog Voice Regenerator
-Toggle button-
Switch to random writer style. Prompt LLM as editor for that writer or style.
Socrates in the style of modern day editors. Wording and speed and etc changed up?
Something to consider is using custom Markdown syntax to set context values parameters. Initial thought was to use this with Spoke posts, where you could trigger an email from the post body using custom syntax. For instance, emailing all followers of the project to ask a question of them. But, it could also be used as a way for writers to set context inline, but also keep flowing with their main storyline.
Landscape
Since starting this blog, I have not looked at other writing or directing editors to see features. I have before. I will again sure. But I am noting ideas that come that may be useful some day.
https://dreamily.ai is almost what I have been working on. The Wardley map is holding true, which again illustrates the obvious, that a class of tools is emerging in this category. I wonder what can be done to get ahead by predicting what will come next, versus just creating in the space that has been opened. Or, is the best path just to work in the space and get a better sense of how to get ahead from that.
Based on MusicLM’s descriptions… even though I don’t have access to it. This is the prompt guide I am going with for now.
Prompt - Perplexity - GPT-4
Brainstorm music that would be appropriate for the following scene in a movie
“Sitting at my desk with the lamp on, it is dark outside, turned my record player on. I have a ton of incense and light one. I sit down and draw at my desk.”
Must: be rich captions such as the following:
“The main soundtrack of an arcade game. It is fast-paced and upbeat, with a catchy electric guitar riff. The music
is repetitive and easy to remember, but with unexpected sounds, like cymbal crashes or drum rolls.”
or “A fusion of reggaeton and electronic dance music, with a spacey, otherworldly sound. Induces the experience of
being lost in space, and the music would be designed to evoke a sense of wonder and awe, while being danceable.”
Must: brainstorm ideas and create a list.
Must: use a numbered list.
Must: only one list.
Should: no more than 2 items.
Should: at least 1 item.
Return it in JSON using the following format: [{ “Soundtrack”: 1, “caption”:”caption of the audio” }]
Result
Based on your preferences and the scene you described, I have brainstormed two music ideas that could be appropriate for this setting:
A blend of ambient and neoclassical music, featuring soothing piano melodies and soft strings, creating a calm and introspective atmosphere. This music would evoke a sense of tranquility and focus, allowing the listener to fully immerse themselves in their creative process while drawing at their desk. Example: “A peaceful piano and string composition, reminiscent of the works of Ludovico Einaudi or Ólafur Arnalds, that creates a serene and contemplative environment, perfect for drawing and introspection.”
A cinematic and atmospheric soundtrack, inspired by the works of composers like Hans Zimmer or Thomas Newman, that combines lush orchestral arrangements with subtle electronic elements. This music would create a sense of wonder and exploration, transporting the listener to a different world as they draw at their desk. Example: “An immersive and evocative soundtrack that fuses orchestral and electronic elements, reminiscent of the scores from movies like ‘Interstellar’ or ‘The Shawshank Redemption,’ designed to inspire creativity and transport the listener to a realm of imagination and discovery.”
Here is the JSON format you requested:
[
{
"Soundtrack": 1,
"caption": "A peaceful piano and string composition, reminiscent of the works of Ludovico Einaudi or Ólafur Arnalds, that creates a serene and contemplative environment, perfect for drawing and introspection."
},
{
"Soundtrack": 2,
"caption": "An immersive and evocative soundtrack that fuses orchestral and electronic elements, reminiscent of the scores from movies like 'Interstellar' or 'The Shawshank Redemption,' designed to inspire creativity and transport the listener to a realm of imagination and discovery."
}
]
Thoughts
Not super happy with the musical choices generated by GPT. They seem too grandiose. The music generator seemed to do a good job, however, of generating what was asked of it. I can see this being a nice add. Again, this would be something the user would choose as a background soundtrack to their clip or scene.
