일상의 끄적거림...

Red Hat AI Inference Server Overview and Installation Guide (Linux)“Anyone who’s actually tried to stand up an LLM server knows this: tokens are cheap, but infrastructure is not.” That’s exactly the gap Red Hat AI Inference Server is trying to fill. It gives you enterprise-grade operations, while still feeling, from a developer’s point of view, like a neatly packaged “vLLM-in-a-box.”1. What is R..

During a recent project, I encountered the need to migrate from Bonobo Git, which we had been using for internal testing purposes, to GitLab.The initial reasons for using Bonobo Git were:Easy installation in a Windows environmentQuick setup with simple functionalityHowever, as the project grew and required more scalability, we decided to switch to GitLab, which allows for configuration in a Linu..

The following error message occurred during the development of a Python application related to LLM, Chroma, and Langchain. It seems to occur when testing in a Python3.11 & Linux environment like mine. When proceeding under the same conditions in a Windows environment, the related error did not occur. If you encounter this error, please take note. [Error Message] RuntimeError: Your system has an ..

hello At some point, interest in generative AI has rapidly increased. And a variety of services are provided to make testing easier. However, students or various business participants (developers and planners) worry about testing simple service implementations. How to make it, where to distribute it?, how much will it cost?, and will it operate stably? Today, I will guide you through creating a ..

Today we will introduce datepicker, which is frequently used in web development. A typical Datepicker displays one calendar. However, sometimes you need a datepicker to set the period. In this case, you must select a start date and an end date. The following script is a sample for selecting a date range. First, I will share the execution screen. https://sensortower.github.io/daterangepicker/docs..

hello This is an introduction to a site that everyone needs at least once for development or learning purposes. This site is for introduction purposes only and has nothing to do with me. In many cases, you may need to convert CSV files to json or vice versa. The site introduced below provides various options in the online UI. In other words, you can simply go to the webpage and take a test or re..

[Prompt] Prompts are guides for generating responses or completing tasks in LLM, called large-scale language models. How you write this prompt will affect the accuracy and format of the answers your model returns. In other words, “Prompt Engineering” is The process of effectively creating and tailoring prompts to an artificial intelligence (AI) model to achieve the desired results . And to write..