NLP Synergy Houdini

I chose one of the most effortless node-based AI approaches for my first experiment: color ramp. It's similar to a gradient bar you see in Adobe Creative Suite, which in Houdini can be used to create a gradient effect over any line or shape made in Houdini; it's easy as it's a node that can be manipulated by parameter. By connecting Open AI API, I can make it a prompt-based approach without any problem where user text base input will be interpreted via a Python code and will give results to change the color ramps.  Using Houdini for this project gives me an advantage as it allows me to interact with the nodes already in the Houdini workspace using Python, also known as Python (Houdini + Python).  Color Ramp AI Node 1. Create a Python node named " color_ramp_GPT ," adding the below code in the content area.  from openai import OpenAI import hou import ast node = hou.pwd() client = OpenAI() def get_completion(user_prompt, system_message):     try:     ...

Over the past few weeks, I have been researching understand how artificial intelligence (AI) can be integrated into 3D software—specifically Houdini and Blender—to enhance visual effects (VFX) workflows. This process wasn’t just about gathering sources or ticking boxes for an assignment; it was a deep dive into the evolving intersection of AI, machine learning operations (MLOps), natural language processing (NLP), and procedural generation. Here’s a candid reflection on what I learned, the problems I faced, and the steps I plan to take as I continue refining my work. Discovering the Building Blocks My literature review started by focusing on key foundational ideas: MLOps as the Backbone: I found a GitHub repository by Bismuth Consultancy BV (n.d.) that introduced me to MLOps—a critical concept that bridges traditional DevOps with the specific needs of AI workflows. This resource gave me a practical understanding of how AI systems are managed, from data versioning to model retraining. ...

Because my Project/Research focuses more on the bridge of how AI and Software come together to form an interesting blend in a 3D space in Blender and Houdini. Below are some references which helped me understand how Machine Learning and Artificial Intelligence go hand in hand with the help of different methods. Primary Sources means sources which are directly affecting my process in the Research and Secondary are peer review and case studies of how they understand the concepts of AI. Primary Sources 1. Bismuth Consultancy BV. (n.d.). MLOPs [GitHub repository] . GitHub. https://github.com/Bismuth-Consultancy-BV/MLOPs   2. OpenAI. (n.d.). Text generation . https://platform.openai.com/docs/guides/text-generation   3. Side Effects Software. (n.d.). SideFXLabs [GitHub repository] . GitHub. https://github.com/sideeffects/SideFXLabs   4. Hugging Face. (n.d.). Models . https://huggingface.co/models?pipeline_tag=text-to-image&sort=downloads   5. Side Eff...

I had an issue while installing MLOPs just following the tutorial, and to solve the problems, I went to different communities but got no solution, in the end, Bismuth's discord community, I got an answer from @.jaydrake who gave me the best steps for the current time to make MLOPs work. Thank you for saving my project. Below are the steps that currently work for setting up MLOPs, which are needed to use Open AI API, with the help of one of the users in the BV's discord server @.jaydrake. Setting up and installing MLOPs: 1. Checking your Python version with Houdini's Python Interpreter by going to the main options bar at the top where Windows -> Python Shell . 2. The choice of Python Interpreter depends upon the user if they will use an external Python environment or hython, which is Python in Houdini. 3. Then go to https://github.com/Bismuth-Consultancy-BV/MLOPs , and install GitHub Desktop, which is the best way to clone the repository inside your computers. This metho...

Below are some of the ideas that popped up in my mind while thinking about what technology I can work on, which will help me learn and also contribute to the field of Digital Media. 1. Topics: Streamlining steps to procedurally generate landscapes in Houdini and Unreal Engine by testing tools with the help of AI! This will help artists work on the parameters to change the landscape, and AI can reduce time by building up the structure and connections required to build that landscape. Whenever I work on any project involving big maps, it makes me feel overwhelmed by how much time it takes to build something from scratch, and procedural generation is one of the solutions that made me feel how much we can improve it just by adding AI. If I could find a tool, the pipeline for developing landscapes would become more streamlined than ever for environmental designers. PCG is research where they use GAN to make landscapes via Height maps. Need to Experiment with AI and work on the concepts to ...