Wang's Tech Blog

Recent Updates Toggle Comment Threads | Keyboard Shortcuts

• 

  Wang 22:04 on 2023-03-29 Permalink | Reply
  Tags: BigData ( 34 ), Metadata   

  Data Package Manager 

  Data Package Manager (datapm) is an open source data publishing platform for private and public use.

  You can publish your own public or private packages and even host your own data registry for private B2B exchange.

  https://datapm.io/

  Like this:

  Like Loading...
   

  Reply Cancel reply

  Name

  Email

  Website

  Notify me of new comments via email.

  Notify me of new posts via email.

  Δ

• 

  Wang 20:07 on 2023-02-16 Permalink | Reply
  Tags: AI ( 4 ), ML Engineering ( 11 ), Model ( 6 )   

  What is generative AI? 

  Generative artificial intelligence (AI) describes algorithms (such as ChatGPT) that can be used to create new content, including audio, code, images, text, simulations, and videos. Recent new breakthroughs in the field have the potential to drastically change the way we approach content creation.

  https://www.mckinsey.com/featured-insights/mckinsey-explainers/what-is-generative-ai

  Like this:

  Like Loading...
   
• 

  Wang 19:12 on 2023-02-01 Permalink | Reply
  Tags: CI/CD ( 6 ), Management ( 3 ), Process   

  Monorepos 

  monorepo.tools

  Like this:

  Like Loading...
   
• 

  Wang 21:01 on 2023-01-27 Permalink | Reply
  Tags: AWS, Azure, Cloud ( 26 ), GCP ( 11 ), ML Engineering ( 11 ), MLOps ( 13 )   

  SkyPilot – A framework for easily and cost-effectively running ML workloads on any cloud

  Like this:

  Like Loading...
   
• 

  Wang 21:28 on 2023-01-16 Permalink | Reply
  Tags: Report, Survey   

  Stack Overflow 2022 Developer Survey

  Like this:

  Like Loading...
   
• 

  Wang 21:18 on 2022-12-22 Permalink | Reply
  Tags: Java ( 8 ), JVM   

  Real – time non-invasive AOP framework container based on JVM

  Like this:

  Like Loading...
   
• 

  Wang 11:59 on 2022-11-11 Permalink | Reply
  Tags: AI ( 4 ), BigData ( 34 ), Cloud ( 26 ), Data Engineering ( 2 ), Databricks, ML Engineering ( 11 )   

  Data + AI Summit 2022 North America/Virtual – All Sessions 

  Like this:

  Like Loading...
   
• 

  Wang 22:48 on 2022-11-05 Permalink | Reply
  Tags: Data Engineering ( 2 ), ML Engineering ( 11 ), MLOps ( 13 )   

  MLOps Principles

  Like this:

  Like Loading...
   
• 

  Wang 22:27 on 2022-10-25 Permalink | Reply
  Tags: Docker ( 27 ), Kubernetes ( 37 ), Mysql ( 7 )   

  Intall Mysql Operator in K8S 

  	#install kind and create local K8S cluster
  	#kind create cluster –name local
  	helm repo add mysql-operator https://mysql.github.io/mysql-operator/
  	helm repo update
  	MYSQL_OPERATOR_NS=mysql-operator
  	helm install mysql-operator mysql-operator/mysql-operator –namespace ${MYSQL_OPERATOR_NS} –create-namespace
  	MYSQL_NAME=mysql
  	MYSQL_NS=mysql
  	MYSQL_USER=root
  	MYSQL_PWD=root
  	MYSQL_SERVER_INSTANCE=1
  	MYSQL_ROUTER_INSTANCE=1
  	helm install ${MYSQL_NAME} mysql-operator/mysql-innodbcluster \
  	–namespace ${MYSQL_NS} \
  	–create-namespace \
  	–version 2.0.5 \
  	–set credentials.root.user=${MYSQL_USER} \
  	–set credentials.root.password=${MYSQL_PWD} \
  	–set credentials.root.host='%' \
  	–set serverInstances=${MYSQL_SERVER_INSTANCE} \
  	–set routerInstances=${MYSQL_ROUTER_INSTANCE} \
  	–set tls.useSelfSigned=true
  	kubectl get service -n ${MYSQL_NS}
  	kubectl port-forward service/${MYSQL_NAME} 3306:3306 -n ${MYSQL_NS}
  	#run mysql client
  	#kubectl run mysql-client –image=mysql:5.7 -it –rm –restart=Never \
  	#— mysql -h${MYSQL_NAME}.${MYSQL_NS}.svc.cluster.local -P3306 -u${MYSQL_USER} -p${MYSQL_PWD}
  	kubectl run mysql-client –image=mysql:5.7 -it –rm –restart=Never /bin/bash
  	mysql -hmysql.mysql.svc.cluster.local -P3306 -uroot -proot
  	#mysql -h127.0.0.1 -P3306 -uroot -p

  view raw k8s_mysql_operator.sh hosted with ❤ by GitHub

  Like this:

  Like Loading...
   
• 

  Wang 22:07 on 2022-10-16 Permalink | Reply
  Tags: GitHub ( 19 ), Product   

  Open Product Management – GitHub

  Like this:

  Like Loading...