Trainium spelling fix

.gitignore

@@ -28,3 +28,13 @@ src/release/2018-09/sample_query.json
 *.swp
 doc/labguide/Korean/~$S Korea AI ML Immersion Day Hands-on PilHoKim 8th October 2018.docx
 doc/labguide/Korean/~$S Korea AI ML Immersion Day Hands-on PilHoKim 23rd November 2018.docx
+
+# Dataset
+
+genai/aws-gen-ai-kr/30_fine_tune/reranker-kr/dataset/msmarco/
+genai/aws-gen-ai-kr/30_fine_tune/reranker-kr/dataset/translated/
+genai/aws-gen-ai-kr/30_fine_tune/reranker-kr/model/
+
+genai/aws-gen-ai-kr/11_bedrock-with-opensearch/data/hanwhalife/
+genai/aws-gen-ai-kr/11_bedrock-with-opensearch/data/kt/
+genai/aws-gen-ai-kr/20_applications/19_agentic_rag/.env

Readme.md

@@ -1,25 +1,29 @@
-# AWS AI/ML Workshop - Korea
+# AWS Generative AI/Machine Learning Samples - Korea
 
-AWS AIML 한글 워크샵 & 예제 모음 
+<p align="left">
+    <a href="https://github.com/aws-samples">
+            <img alt="Build" src="https://img.shields.io/badge/Contribution-Welcome-blue">
+    </a>
+    <a href="https://github.com/aws-samples/aws-ai-ml-workshop-kr/blob/master/LICENSE">
+        <img alt="License" src="https://img.shields.io/badge/LICENSE-MIT-green">
+    </a>
+    <a href="https://hits.seeyoufarm.com"><img src="https://hits.seeyoufarm.com/api/count/incr/badge.svg?url=https%3A%2F%2Fgithub.com%2Faws-samples%2Faws-ai-ml-workshop-kr&count_bg=%2379C83D&title_bg=%23555555&icon=&icon_color=%23E7E7E7&title=hits&edge_flat=false"/></a>
+</p>
 
----
-
-## 디렉토리 구조
-
-본 리포지토리의 예제 코드는 아래 4가지 카테고리로 나뉘어 있습니다. 각 디렉토리별 Readme 파일을 참고하십시오.
+## 디렉토리 구조 
 
-- [AI services](aiservices/Readme.md) : Amazon Rekognition, Amazon Textract 등 학습없이 사용 가능한 AIML 서비스 활용 예제
-- [Applied AI](appliedai/Readme.md) : Amazon Personalize, Amazon Forecast 등 사용자 데이터를 이용한 커스텀 ML 모델 생성/추론 서비스
-- [SageMaker](sagemaker/Readme.md) : End-to-end 머신러닝/딥러닝 플랫폼 SageMaker 활용 예제
-- [Integration](integration/Readme.md) : Greengrass, EMR 등 다른 서비스와의 융합 및 응용사례
-- [Generative AI](genai/Readme.md) : Generative AI와 관련된 예제 및 관련 서비스 응용사례
----
-
-## SageMaker 셀프스터디
+AWS AIML 코드 및 워크샵 예제가 있습니다.
+본 리포지토리의 대표 코드를 아래 3가지 카테고리를 보시면 됩니다. 각 디렉토리별 Readme 파일을 참고하십시오.
 
-다음은 SageMaker를 Self study로 학습하고자 할 때 유용한 정보들입니다.
+- [Generative AI](https://github.com/aws-samples/aws-ai-ml-workshop-kr/tree/master/genai/aws-gen-ai-kr/20_applications) : Generative AI와 관련된 예제 및 관련 서비스 응용사례
+    - [AWS Generative AI Applications](https://github.com/aws-samples/aws-ai-ml-workshop-kr/tree/master/genai/aws-gen-ai-kr/20_applications)
+    - [AWS Generative AI Model Deployment (Inference)](https://github.com/aws-samples/aws-ai-ml-workshop-kr/tree/master/genai/aws-gen-ai-kr/40_inference)
+    - [AWS Generative AI Model Fine-tuning (Training)](https://github.com/aws-samples/aws-ai-ml-workshop-kr/tree/master/genai/aws-gen-ai-kr/30_fine_tune)
+- [SageMaker AI](sagemaker/Readme.md) : End-to-end 머신러닝/딥러닝 플랫폼 SageMaker 활용 예제
+    - [SageMaker AI 101 - SageMaker 훈련 시작하기 (입문)](https://github.com/aws-samples/aws-ai-ml-workshop-kr/tree/master/sagemaker/01-sagemaker-101)
+    - [SageMaker HyperPod - 모델 훈련 ](https://github.com/aws-samples/aws-ai-ml-workshop-kr/tree/master/sagemaker/hyperpod)    
+- [AWS Neuron](neuron/Readme.md) : AWS Neuron (Inferentia, Inferentia2, Trainium )의 관련된 예제 및 활용
 
-- [문곤수님 gihtub](https://github.com/gonsoomoon-ml/Self-Study-On-SageMaker/blob/main/README.md)
 
 ---
 
@@ -31,4 +35,4 @@ This library is licensed under the Apache 2.0 License. For more details, please
 ## Contributing
 Although we're extremely excited to receive contributions from the community, we're still working on the best mechanism to take in examples from external sources. Please bear with us in the short-term if pull requests take longer than expected or are closed. Please read our contributing guidelines if you'd like to open an issue or submit a pull request.
 
----
+---

genai/aws-gen-ai-kr/00_setup/README.md

@@ -0,0 +1,7 @@
+# Lab 0 - Introduction to Bedrock
+
+This lab will walk you through the basics of connecting to the Amazon Bedrock service from Python.
+
+First, ensure you've completed the setup in the ['Getting Started' section of the root README](../README.md#Getting-started)
+
+Then, you'll be ready to walk through the notebook [bedrock_boto3_setup.ipynb](bedrock_boto3_setup.ipynb), which shows how to install the required SDKs, connect to Bedrock, and invoke models.

genai/aws-gen-ai-kr/00_setup/backup/create-user-profile.ipynb

@@ -0,0 +1,198 @@
+{
+ "cells": [
+  {
+   "cell_type": "markdown",
+   "id": "fd3df705-f947-4a39-b819-1cf364d68fee",
+   "metadata": {
+    "tags": []
+   },
+   "source": [
+    "# SageMaker Studio Domain 에 User Profile 생성하기\n",
+    "\n",
+    "- 참고자료\n",
+    "    - [create_user_profile](https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/sagemaker/client/create_user_profile.html#)"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "93a308b2-2d5c-4e56-9dcb-2d28f9826d72",
+   "metadata": {},
+   "source": [
+    "## 선수 사항\n",
+    "SageMakerFullAccess 에는 아래와 같은 권한이 기본적으로 없습니다. 노트북을 실행하는 역할에 아래 권한을 추가 해주세요.\n",
+    "```\n",
+    "{\n",
+    "\t\"Version\": \"2012-10-17\",\n",
+    "\t\"Statement\": [\n",
+    "\t\t{\n",
+    "\t\t\t\"Sid\": \"VisualEditor0\",\n",
+    "\t\t\t\"Effect\": \"Allow\",\n",
+    "\t\t\t\"Action\": \"sagemaker:CreateUserProfile\",\n",
+    "\t\t\t\"Resource\": \"*\"\n",
+    "\t\t}\n",
+    "\t]\n",
+    "}\n",
+    "```"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 1,
+   "id": "df97ff5f-1cfc-454d-ae9a-1972aa8b1e82",
+   "metadata": {
+    "tags": []
+   },
+   "outputs": [],
+   "source": [
+    "import boto3\n",
+    "\n",
+    "client = boto3.client(\"sagemaker\", 'us-east-1')"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 11,
+   "id": "735f03d4-a57e-45c8-84a8-d26081371506",
+   "metadata": {
+    "tags": []
+   },
+   "outputs": [],
+   "source": [
+    "response = client.create_user_profile(\n",
+    "    DomainId='d-cv1ust5q5dga',\n",
+    "    UserProfileName='mx-10',\n",
+    "    # SingleSignOnUserIdentifier='string',\n",
+    "    # SingleSignOnUserValue='string',\n",
+    "    # Tags=[\n",
+    "    #     {\n",
+    "    #         'Key': 'string',\n",
+    "    #         'Value': 'string'\n",
+    "    #     },\n",
+    "    # ],\n",
+    "    UserSettings={\n",
+    "        'ExecutionRole': 'arn:aws:iam::642011685407:role/SageMakerExecutionRole-us-east-1-cdk',\n",
+    "        # 'SecurityGroups': [\n",
+    "        #     'string',\n",
+    "        # ],\n",
+    "        # 'SharingSettings': {\n",
+    "        #     'NotebookOutputOption': 'Allowed'|'Disabled',\n",
+    "        #     'S3OutputPath': 'string',\n",
+    "        #     'S3KmsKeyId': 'string'\n",
+    "        # },\n",
+    "        # 'JupyterServerAppSettings': {\n",
+    "        #     'DefaultResourceSpec': {\n",
+    "        #         'SageMakerImageArn': 'string',\n",
+    "        #         'SageMakerImageVersionArn': 'string',\n",
+    "        #         'InstanceType': 'system'|'ml.t3.micro'|'ml.t3.small'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.m5d.large'|'ml.m5d.xlarge'|'ml.m5d.2xlarge'|'ml.m5d.4xlarge'|'ml.m5d.8xlarge'|'ml.m5d.12xlarge'|'ml.m5d.16xlarge'|'ml.m5d.24xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.p3.2xlarge'|'ml.p3.8xlarge'|'ml.p3.16xlarge'|'ml.p3dn.24xlarge'|'ml.g4dn.xlarge'|'ml.g4dn.2xlarge'|'ml.g4dn.4xlarge'|'ml.g4dn.8xlarge'|'ml.g4dn.12xlarge'|'ml.g4dn.16xlarge'|'ml.r5.large'|'ml.r5.xlarge'|'ml.r5.2xlarge'|'ml.r5.4xlarge'|'ml.r5.8xlarge'|'ml.r5.12xlarge'|'ml.r5.16xlarge'|'ml.r5.24xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.16xlarge'|'ml.g5.12xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.geospatial.interactive'|'ml.p4d.24xlarge'|'ml.p4de.24xlarge',\n",
+    "        #         'LifecycleConfigArn': 'string'\n",
+    "        #     },\n",
+    "        #     'LifecycleConfigArns': [\n",
+    "        #         'string',\n",
+    "        #     ],\n",
+    "        #     'CodeRepositories': [\n",
+    "        #         {\n",
+    "        #             'RepositoryUrl': 'string'\n",
+    "        #         },\n",
+    "        #     ]\n",
+    "        # },\n",
+    "        # 'KernelGatewayAppSettings': {\n",
+    "        #     'DefaultResourceSpec': {\n",
+    "        #         'SageMakerImageArn': 'string',\n",
+    "        #         'SageMakerImageVersionArn': 'string',\n",
+    "        #         'InstanceType': 'system'|'ml.t3.micro'|'ml.t3.small'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.m5d.large'|'ml.m5d.xlarge'|'ml.m5d.2xlarge'|'ml.m5d.4xlarge'|'ml.m5d.8xlarge'|'ml.m5d.12xlarge'|'ml.m5d.16xlarge'|'ml.m5d.24xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.p3.2xlarge'|'ml.p3.8xlarge'|'ml.p3.16xlarge'|'ml.p3dn.24xlarge'|'ml.g4dn.xlarge'|'ml.g4dn.2xlarge'|'ml.g4dn.4xlarge'|'ml.g4dn.8xlarge'|'ml.g4dn.12xlarge'|'ml.g4dn.16xlarge'|'ml.r5.large'|'ml.r5.xlarge'|'ml.r5.2xlarge'|'ml.r5.4xlarge'|'ml.r5.8xlarge'|'ml.r5.12xlarge'|'ml.r5.16xlarge'|'ml.r5.24xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.16xlarge'|'ml.g5.12xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.geospatial.interactive'|'ml.p4d.24xlarge'|'ml.p4de.24xlarge',\n",
+    "        #         'LifecycleConfigArn': 'string'\n",
+    "        #     },\n",
+    "        #     'CustomImages': [\n",
+    "        #         {\n",
+    "        #             'ImageName': 'string',\n",
+    "        #             'ImageVersionNumber': 123,\n",
+    "        #             'AppImageConfigName': 'string'\n",
+    "        #         },\n",
+    "        #     ],\n",
+    "        #     'LifecycleConfigArns': [\n",
+    "        #         'string',\n",
+    "        #     ]\n",
+    "        # },\n",
+    "        # 'TensorBoardAppSettings': {\n",
+    "        #     'DefaultResourceSpec': {\n",
+    "        #         'SageMakerImageArn': 'string',\n",
+    "        #         'SageMakerImageVersionArn': 'string',\n",
+    "        #         'InstanceType': 'system'|'ml.t3.micro'|'ml.t3.small'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.m5d.large'|'ml.m5d.xlarge'|'ml.m5d.2xlarge'|'ml.m5d.4xlarge'|'ml.m5d.8xlarge'|'ml.m5d.12xlarge'|'ml.m5d.16xlarge'|'ml.m5d.24xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.p3.2xlarge'|'ml.p3.8xlarge'|'ml.p3.16xlarge'|'ml.p3dn.24xlarge'|'ml.g4dn.xlarge'|'ml.g4dn.2xlarge'|'ml.g4dn.4xlarge'|'ml.g4dn.8xlarge'|'ml.g4dn.12xlarge'|'ml.g4dn.16xlarge'|'ml.r5.large'|'ml.r5.xlarge'|'ml.r5.2xlarge'|'ml.r5.4xlarge'|'ml.r5.8xlarge'|'ml.r5.12xlarge'|'ml.r5.16xlarge'|'ml.r5.24xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.16xlarge'|'ml.g5.12xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.geospatial.interactive'|'ml.p4d.24xlarge'|'ml.p4de.24xlarge',\n",
+    "        #         'LifecycleConfigArn': 'string'\n",
+    "        #     }\n",
+    "        # },\n",
+    "        # 'RStudioServerProAppSettings': {\n",
+    "        #     'AccessStatus': 'ENABLED'|'DISABLED',\n",
+    "        #     'UserGroup': 'R_STUDIO_ADMIN'|'R_STUDIO_USER'\n",
+    "        # },\n",
+    "        # 'RSessionAppSettings': {\n",
+    "        #     'DefaultResourceSpec': {\n",
+    "        #         'SageMakerImageArn': 'string',\n",
+    "        #         'SageMakerImageVersionArn': 'string',\n",
+    "        #         'InstanceType': 'system'|'ml.t3.micro'|'ml.t3.small'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.m5d.large'|'ml.m5d.xlarge'|'ml.m5d.2xlarge'|'ml.m5d.4xlarge'|'ml.m5d.8xlarge'|'ml.m5d.12xlarge'|'ml.m5d.16xlarge'|'ml.m5d.24xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.p3.2xlarge'|'ml.p3.8xlarge'|'ml.p3.16xlarge'|'ml.p3dn.24xlarge'|'ml.g4dn.xlarge'|'ml.g4dn.2xlarge'|'ml.g4dn.4xlarge'|'ml.g4dn.8xlarge'|'ml.g4dn.12xlarge'|'ml.g4dn.16xlarge'|'ml.r5.large'|'ml.r5.xlarge'|'ml.r5.2xlarge'|'ml.r5.4xlarge'|'ml.r5.8xlarge'|'ml.r5.12xlarge'|'ml.r5.16xlarge'|'ml.r5.24xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.16xlarge'|'ml.g5.12xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.geospatial.interactive'|'ml.p4d.24xlarge'|'ml.p4de.24xlarge',\n",
+    "        #         'LifecycleConfigArn': 'string'\n",
+    "        #     },\n",
+    "        #     'CustomImages': [\n",
+    "        #         {\n",
+    "        #             'ImageName': 'string',\n",
+    "        #             'ImageVersionNumber': 123,\n",
+    "        #             'AppImageConfigName': 'string'\n",
+    "        #         },\n",
+    "        #     ]\n",
+    "        # },\n",
+    "        # 'CanvasAppSettings': {\n",
+    "        #     'TimeSeriesForecastingSettings': {\n",
+    "        #         'Status': 'ENABLED'|'DISABLED',\n",
+    "        #         'AmazonForecastRoleArn': 'string'\n",
+    "        #     },\n",
+    "        #     'ModelRegisterSettings': {\n",
+    "        #         'Status': 'ENABLED'|'DISABLED',\n",
+    "        #         'CrossAccountModelRegisterRoleArn': 'string'\n",
+    "        #     },\n",
+    "        #     'WorkspaceSettings': {\n",
+    "        #         'S3ArtifactPath': 'string',\n",
+    "        #         'S3KmsKeyId': 'string'\n",
+    "        #     },\n",
+    "        #     'IdentityProviderOAuthSettings': [\n",
+    "        #         {\n",
+    "        #             'DataSourceName': 'SalesforceGenie'|'Snowflake',\n",
+    "        #             'Status': 'ENABLED'|'DISABLED',\n",
+    "        #             'SecretArn': 'string'\n",
+    "        #         },\n",
+    "        #     ]\n",
+    "        # }\n",
+    "    }\n",
+    ")"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "id": "cbef4584-6540-4d6a-901d-175f5c8ca3b3",
+   "metadata": {},
+   "outputs": [],
+   "source": []
+  }
+ ],
+ "metadata": {
+  "kernelspec": {
+   "display_name": "conda_python3",
+   "language": "python",
+   "name": "conda_python3"
+  },
+  "language_info": {
+   "codemirror_mode": {
+    "name": "ipython",
+    "version": 3
+   },
+   "file_extension": ".py",
+   "mimetype": "text/x-python",
+   "name": "python",
+   "nbconvert_exporter": "python",
+   "pygments_lexer": "ipython3",
+   "version": "3.10.12"
+  }
+ },
+ "nbformat": 4,
+ "nbformat_minor": 5
+}