Oracle Updated 1z0-1127-24 Exam Questions and Answers by melanie

Using small data sets with the Vanilla fine-tuning method in the OCI Generative AI service might result in underfitting. Underfitting occurs when a model is too simplistic to capture the underlying patterns in the data, leading to poor performance on both training and validation data. This is particularly problematic with small data sets because there may not be enough information for the model to learn the necessary patterns and relationships.

References

Articles on machine learning challenges with small data sets

Technical documentation on fine-tuning models in OCI

In LangChain, the "mmr" (Maximal Marginal Relevance) search type is used to balance between relevancy and diversity when retrieving documents. This technique aims to select documents that are not only relevant to the query but also diverse from each other. This helps in avoiding redundancy and ensures that the retrieved set of documents covers a broader aspect of the topic.

Maximal Marginal Relevance (MMR) works by iteratively selecting documents that have high relevance to the query but low similarity to the documents already selected. This ensures that each new document adds new information and perspectives, rather than repeating what is already included.

References

LangChain documentation on retrievers and search types

Research papers and articles on Maximal Marginal Relevance (MMR)

Chain-of-Thought prompting involves prompting the Large Language Model (LLM) to emit intermediate reasoning steps as part of its response. This technique helps the model articulate its thought process and reasoning, leading to more transparent and understandable outputs. By breaking down the problem into smaller, logical steps, the model can provide more accurate and detailed responses.

References

Research articles on Chain-of-Thought prompting

Technical guides on enhancing model transparency and reasoning with intermediate steps

The architecture of dedicated AI clusters contributes to minimizing GPU memory overhead for fine-tuned model inference by sharing base model weights across multiple fine-tuned models on the same group of GPUs. This approach allows different fine-tuned models to leverage the shared base model weights, reducing the memory requirements and enabling efficient use of GPU resources. By not duplicating the base model weights for each fine-tuned model, the system can handle more models simultaneously with lower memory overhead.

References

Technical documentation on AI cluster architectures

Research articles on optimizing GPU memory utilization in model inference