https://nianjiang.github.io/docs/70-CNCF/Recent content in CNCF & Infracture on Learning NotesHugozhhttps://nianjiang.github.io/docs/70-CNCF/40Observe/Mon, 01 Jan 0001 00:00:00 +0000https://nianjiang.github.io/docs/70-CNCF/40Observe/<h1 id="learning-notes"> Learning Notes <a class="anchor" href="#learning-notes">#</a> </h1> <blockquote> <p>This is my learning Notes for Monitor/Metrics/Tracing</p> </blockquote> <h2 id="monitoring"> Monitoring <a class="anchor" href="#monitoring">#</a> </h2> <table> <thead> <tr> <th>Name</th> <th>Docs</th> <th>Codes</th> <th>Comments</th> <th>Next</th> </tr> </thead> <tbody> <tr> <td> <a href="https://opentelemetry.io/">OpenTelemetry</a></td> <td> <a href="https://opentelemetry.io/docs/">Docs</a></td> <td> <a href="https://github.com/open-telemetry">Github</a></td> <td>OpenTelemetry is a collection of APIs, SDKs, and tools for generating, collecting, and exporting telemetry data (traces, metrics, and logs).</td> <td> <a href="https://www.cncf.io/training/courses/?_sft_lf-project=opentelemetry">Getting Started with OpenTelemetry</a></td> </tr> <tr> <td> <a href="https://prometheus.io/">Prometheus</a></td> <td> <a href="https://prometheus.io/docs/introduction/overview/">Docs</a></td> <td> <a href="https://github.com/prometheus/prometheus">Github</a></td> <td>Prometheus is a systems and service monitoring system.</td> <td></td> </tr> <tr> <td> <a href="https://thanos.io/">Thanos</a></td> <td> <a href="https://thanos.io/tip/thanos/getting-started.md/">Docs</a></td> <td> <a href="https://github.com/thanos-io/thanos">Github</a></td> <td>Thanos is a set of components that can be composed into a highly available Prometheus setup.</td> <td></td> </tr> <tr> <td> <a href="https://www.zabbix.com/cn">Zabbix</a></td> <td> <a href="https://www.zabbix.com/documentation/current/en/manual/introduction">Docs</a></td> <td> <a href="https://github.com/zabbix/zabbix">Github</a></td> <td>Zabbix is an enterprise-class open-source monitoring solution for tracking the status of various network services, servers, and other network hardware.</td> <td></td> </tr> <tr> <td> <a href="https://grafana.com/oss/grafana/">Grafana</a></td> <td> <a href="https://grafana.com/docs/grafana/latest/">Docs</a></td> <td> <a href="https://github.com/grafana/grafana">Github</a></td> <td>Grafana is an open source, feature rich metrics dashboard and graph editor for Graphite, InfluxDB, Prometheus and other time series databases.</td> <td></td> </tr> <tr> <td> <a href="https://zipkin.io/">Zipkin</a></td> <td> <a href="https://zipkin.io/pages/quickstart">Docs</a></td> <td> <a href="https://github.com/openzipkin/zipkin">Github</a></td> <td>Zipkin is a distributed tracing system.</td> <td></td> </tr> <tr> <td> <a href="https://www.fluentd.org/">Fluentd</a></td> <td> <a href="https://docs.fluentd.org/v1.0/articles/quickstart">Docs</a></td> <td> <a href="https://github.com/fluent/fluentd">Github</a></td> <td>Fluentd is an open source data collector for unified logging layer.</td> <td></td> </tr> <tr> <td> <a href="https://www.elastic.co/kibana">Kibana</a></td> <td> <a href="https://www.elastic.co/guide/en/kibana/current/index.html">Docs</a></td> <td> <a href="https://github.com/elastic/kibana">Github</a></td> <td>Kibana is an open source data visualization plugin for Elasticsearch.</td> <td></td> </tr> <tr> <td> <a href="https://grafana.com/oss/loki/">Loki</a></td> <td> <a href="https://grafana.com/docs/loki/latest/">Docs</a></td> <td> <a href="https://github.com/grafana/loki">Github</a></td> <td>Loki is a horizontally-scalable, highly-available, multi-tenant log aggregation system inspired by Prometheus.</td> <td></td> </tr> </tbody> </table> <hr> <h2 id="prometheus"> Prometheus <a class="anchor" href="#prometheus">#</a> </h2> <p> <img src="https://prometheus.io/assets/docs/architecture.svg" alt="Architecture" /></p>https://nianjiang.github.io/docs/70-CNCF/50Logging/Mon, 01 Jan 0001 00:00:00 +0000https://nianjiang.github.io/docs/70-CNCF/50Logging/<h2 id="logging-tools"> Logging Tools: <a class="anchor" href="#logging-tools">#</a> </h2> <table> <thead> <tr> <th>Name</th> <th>Docs</th> <th>Codes</th> <th>Comments</th> <th>Demo</th> <th>Other</th> </tr> </thead> <tbody> <tr> <td> <a href="https://www.fluentd.org/">Fluentd</a></td> <td> <a href="https://docs.fluentd.org/quickstart">Docs</a></td> <td> <a href="https://github.com/fluent/fluentd">C,Ruby</a></td> <td></td> <td> <a href="https://docs.fluentbit.io/manual/installation/downloads/docker">Fluent BIT</a></td> <td> <a href="https://www.fluentd.org/videos">Videos</a>, <a href="https://www.fluentd.org/slides">Slides</a></td> </tr> <tr> <td> <a href="https://nianjiang.github.io/"></a></td> <td> <a href="https://nianjiang.github.io/">Docs</a></td> <td> <a href="https://nianjiang.github.io/">Github</a></td> <td></td> <td></td> <td></td> </tr> <tr> <td> <a href="https://nianjiang.github.io/"></a></td> <td> <a href="https://nianjiang.github.io/">Docs</a></td> <td> <a href="https://nianjiang.github.io/">Github</a></td> <td></td> <td></td> <td></td> </tr> <tr> <td> <a href="https://nianjiang.github.io/"></a></td> <td> <a href="https://nianjiang.github.io/">Docs</a></td> <td> <a href="https://nianjiang.github.io/">Github</a></td> <td></td> <td></td> <td></td> </tr> <tr> <td> <a href="https://www.rizhiyi.com/">日志易</a></td> <td></td> <td></td> <td>Not Free</td> <td></td> <td></td> </tr> <tr> <td> <a href="https://www.datadoghq.com/product/">DATADOG</a></td> <td></td> <td></td> <td>Not Free</td> <td></td> <td></td> </tr> </tbody> </table> <h3 id="reference"> Reference <a class="anchor" href="#reference">#</a> </h3> <p> <a href="https://landscape.cncf.io/guide#observability-and-analysis">Observability and Analysis</a></p> <p> <a href="https://docs.qq.com/doc/DVHFJTkpGUHJQa1Bw?no_promotion=1">Tencent</a></p> <p> <a href="https://www.splunk.com/en_us/about-splunk.html">splunk</a></p> <p> <a href="https://asmcn.icopy.site/awesome/awesome-go/">超赞合集</a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p>https://nianjiang.github.io/docs/70-CNCF/80_Redis/Mon, 01 Jan 0001 00:00:00 +0000https://nianjiang.github.io/docs/70-CNCF/80_Redis/<h3 id="redis"> <a href="https://redis.io/">Redis</a> <a class="anchor" href="#redis">#</a> </h3> <hr> <h3 id="comparison-of-ha-strategies"> Comparison of HA Strategies <a class="anchor" href="#comparison-of-ha-strategies">#</a> </h3> <table> <thead> <tr> <th>Feature</th> <th>Redis Sentinel</th> <th>Redis Cluster</th> <th>Note</th> </tr> </thead> <tbody> <tr> <td>Best For</td> <td>High availability with a single master.</td> <td>Scaling large datasets across multiple masters.</td> <td></td> </tr> <tr> <td>Failover</td> <td>Automatic (Sentinel promotes a slave).</td> <td>Automatic (Nodes agree on promotion).</td> <td></td> </tr> <tr> <td>Client Support</td> <td>Requires Sentinel-aware client.</td> <td>Requires Cluster-aware client.</td> <td></td> </tr> <tr> <td>GitHub Example</td> <td> <a href="https://github.com/spotahome/redis-operator">spotahome/redis-operator</a></td> <td> <a href="https://github.com/bitnami/charts/tree/main/bitnami/redis-cluster">bitnami/redis-cluster</a></td> <td></td> </tr> </tbody> </table> <hr> <h3 id=""> <a class="anchor" href="#">#</a> </h3> <hr> <h3 id="reference"> Reference <a class="anchor" href="#reference">#</a> </h3> <p> <a href="https://redis.io/docs/latest/operate/oss_and_stack/management/sentinel/">Redis-Sentinel</a></p> <p> <a href="https://medium.com/@khandelwal.praful/understanding-redis-high-availability-cluster-vs-sentinel-420ecaac3236">Understanding Redis High Availability: Cluster vs. Sentinel</a></p> <p> <a href="https://redis.io/">Redis</a></p> <p> <a href="https://github.com/redis/redis">Github</a></p> <p> <a href="https://cloud.redis.io/#/databases">cloud.redis.io</a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p> <p> <a href="https://nianjiang.github.io/"></a></p>https://nianjiang.github.io/docs/70-CNCF/90_Iac/Mon, 01 Jan 0001 00:00:00 +0000https://nianjiang.github.io/docs/70-CNCF/90_Iac/<h3 id="redis"> <a href="https://redis.io/">Redis</a> <a class="anchor" href="#redis">#</a> </h3> <hr> <h3 id="tools"> Tools <a class="anchor" href="#tools">#</a> </h3> <table> <thead> <tr> <th>Name</th> <th>Docs</th> <th>Codes</th> <th>Other</th> <th>Comments</th> <th>Demo</th> </tr> </thead> <tbody> <tr> <td> <a href="https://developer.hashicorp.com/terraform">Terraform</a></td> <td> <a href="https://developer.hashicorp.com/terraform/docs">docs</a></td> <td> <a href="https://github.com/hashicorp/terraform">code</a></td> <td> <a href="https://registry.terraform.io/browse/providers">Providers</a></td> <td></td> <td> <a href="https://www.terraform.io/intro/getting-started/install.html">demo</a></td> </tr> <tr> <td> <a href="https://help.aliyun.com/zh/terraform/">Terraform-Aliyun</a></td> <td> <a href="https://github.com/alibabacloud-automation/landing-with-terraform/tree/main/quickstarts">quickstarts</a></td> <td> <a href="https://github.com/aliyun/terraform-provider-alicloud/tree/master">code</a></td> <td> <a href="https://registry.terraform.io/browse/modules?provider=alibaba">Models</a>, <a href="https://api.aliyun.com/terraform">Terraform Explorer</a></td> <td></td> <td> <a href="https://github.com/alibabacloud-automation">alibabacloud-automation</a></td> </tr> <tr> <td> <a href="https://www.ansible.com/">Ansible</a></td> <td> <a href="https://docs.ansible.com/">docs</a></td> <td> <a href="https://github.com/ansible/ansible">code</a></td> <td> <a href="https://galaxy.ansible.com">Ansible Galaxy</a> (社区角色与集合)</td> <td>无代理的自动化工具，擅长配置管理、应用部署和任务编排，采用 YAML Playbook 语法。</td> <td> <a href="https://www.ansible.com/get-started">demo</a></td> </tr> <tr> <td> <a href="https://opentofu.org/">OpenTofu</a></td> <td> <a href="https://opentofu.org/docs/">docs</a></td> <td> <a href="https://github.com/opentofu/opentofu">code</a></td> <td> <a href="https://opentofu.org/docs/internals/oci-registry-support/">OCI Registry Support</a>, <a href="https://search.opentofu.org/">Registry Search</a></td> <td>Terraform 的开源分支 (Linux 基金会项目)，100% 兼容 HCL 语法及 Provider/Module，无厂商锁定。</td> <td> <a href="https://opentofu.org/docs/intro/getting-started/">OpenTofu + AWS 快速入门</a></td> </tr> <tr> <td> <a href="https://www.pulumi.com/">Pulumi</a></td> <td> <a href="https://www.pulumi.com/docs/">docs</a></td> <td> <a href="https://github.com/pulumi/pulumi">code</a></td> <td> <a href="https://app.pulumi.com/">Pulumi Cloud</a>, <a href="https://www.pulumi.com/product/pulumi-ai/">Pulumi Neo (AI Agent)</a>[reference:1]</td> <td>支持通用编程语言 (TypeScript/Python/Go/C#/Java) 编写 IaC，原生提供状态管理、自动化 API 及 AI Agent（Neo）。</td> <td> <a href="https://github.com/pulumi/examples">Pulumi Examples</a>, <a href="https://www.pulumi.com/aws/">AWS Quickstart Demo</a></td> </tr> <tr> <td> <a href="https://www.crossplane.io/">Crossplane</a></td> <td> <a href="https://docs.crossplane.io/">docs</a></td> <td> <a href="https://github.com/crossplane/crossplane">code</a></td> <td> <a href="https://www.upbound.io/">Upbound</a> (Crossplane 商业平台), <a href="https://marketplace.upbound.io/providers">Provider Marketplace</a></td> <td>Kubernetes 原生控制平面，将基础设施抽象为 K8s CRD，通过声明式 API 管理和组合云资源。</td> <td> <a href="https://docs.upbound.io/getting-started/">Upbound Getting Started</a>, <a href="https://pkg.go.dev/xfn-demo">xfn-demo</a></td> </tr> <tr> <td> <a href="https://backstage.io/">Backstage</a></td> <td></td> <td></td> <td></td> <td></td> <td></td> </tr> <tr> <td> <a href="https://nianjiang.github.io/"></a></td> <td></td> <td></td> <td></td> <td></td> <td></td> </tr> </tbody> </table> <hr> <h3 id="middleware"> Middleware <a class="anchor" href="#middleware">#</a> </h3> <table> <thead> <tr> <th>Name</th> <th>Docs</th> <th>Codes</th> <th>Comments</th> <th>Demo</th> <th>Other</th> </tr> </thead> <tbody> <tr> <td> <a href="https://higress.io/">Higress</a></td> <td> <a href="https://higress.io/docs/latest/overview/what-is-higress">docs</a></td> <td> <a href="https://github.com/higress-group/higress">code</a></td> <td>AI Native API 网关，基于 Istio + Envoy</td> <td> <a href="http://demo.higress.io/">demo</a></td> <td>AI 网关、API 网关、HiMarket</td> </tr> <tr> <td> <a href="https://www.envoyproxy.io/">Envoy</a></td> <td> <a href="https://www.envoyproxy.io/docs">docs</a></td> <td> <a href="https://github.com/envoyproxy/envoy">code</a></td> <td>高性能边缘/中间/服务代理</td> <td> <a href="https://www.envoyproxy.io/docs/envoy/latest/start/quick-start/run-envoy">demo</a></td> <td>Service Mesh 数据面核心组件</td> </tr> <tr> <td> <a href="https://istio.io/">Istio</a></td> <td> <a href="https://istio.io/latest/docs/">docs</a></td> <td> <a href="https://github.com/istio/istio">code</a></td> <td>开源服务网格，流量管理、策略与遥测</td> <td> <a href="https://istio.io/latest/docs/setup/getting-started/">demo</a></td> <td>采用 demo 配置，附带 Bookinfo 示例应用</td> </tr> </tbody> </table> <hr> <h3 id="aliyun"> Aliyun <a class="anchor" href="#aliyun">#</a> </h3> <table> <thead> <tr> <th>Name</th> <th>Other</th> </tr> </thead> <tbody> <tr> <td> <a href="https://help.aliyun.com/zh/sls/kubernetes-cluster-container-log-collection-instructions?spm=a2c4g.11174283.help-menu-28958.d_2_2_1_0.165c2842Gbq66p">Kubernetes集群容器日志采集须知</a></td> <td></td> </tr> <tr> <td> <a href="https://nianjiang.github.io/"></a></td> <td></td> </tr> <tr> <td> <a href="https://nianjiang.github.io/"></a></td> <td></td> </tr> <tr> <td> <a href="https://nianjiang.github.io/"></a></td> <td></td> </tr> <tr> <td> <a href="https://nianjiang.github.io/"></a></td> <td></td> </tr> <tr> <td> <a href="https://nianjiang.github.io/"></a></td> <td></td> </tr> </tbody> </table> <hr> <h3 id="platform-engineering-总体架构"> Platform Engineering 总体架构 <a class="anchor" href="#platform-engineering-%e6%80%bb%e4%bd%93%e6%9e%b6%e6%9e%84">#</a> </h3> <p>┌───────────────────────────────┐ │ Developers │ └──────────────┬────────────────┘</p>