You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
KubeEdge Bot 946f92a9d4
Merge pull request #325 from vcozzolino/bug-324
1 week ago
.github add pr template. 4 months ago
LICENSES Update vendor and LICENSE 3 months ago
build Merge pull request #315 from JimmyYang20/il-compute 3 weeks ago
cmd lc: decouple all features into independent package 10 months ago
docs Add Multi Edge Inference feature proposal 3 weeks ago
examples Merge pull request #319 from vcozzolino/feature-reid 2 weeks ago
hack Merge pull request #230 from llhuii/docker-buildx-speed 7 months ago
lib Fix code regression in JobBase class. 2 weeks ago
pkg Merge pull request #319 from vcozzolino/feature-reid 2 weeks ago
scripts Fixbug: cloud node cannot connect k8s apiservice 3 months ago
test Remove khalid-davis from OWNERS 1 year ago
vendor Update vendor and LICENSE 3 months ago
.dockerignore Add local-up.sh 1 year ago
.gitignore Enhance Makefile 1 year ago
.golangci.yml Add basic common files of framework 1 year ago
CODE_OF_CONDUCT.md Add contributing docs 10 months ago
CONTRIBUTING.md Add contributing docs 10 months ago
LICENSE Initial commit 1 year ago
Makefile Fix bug: control plane supports arm64 8 months ago
OWNERS Remove khalid-davis from OWNERS 1 year ago
README.md Add MultiEdgeInference example to main page 3 weeks ago
README_zh.md Fixed bugs of running tensorflow framework and supported different folds for storing pretrained model and aftertrained model. 9 months ago
go.mod Update vendor and LICENSE 3 months ago
go.sum Update vendor and LICENSE 3 months ago

README.md

English | 简体中文

Sedna

CI
Go Report Card
LICENSE

What is Sedna?

Sedna is an edge-cloud synergy AI project incubated in KubeEdge SIG AI. Benefiting from the edge-cloud synergy capabilities provided by KubeEdge, Sedna can implement across edge-cloud collaborative training and collaborative inference capabilities, such as joint inference, incremental learning, federated learning, and lifelong learning. Sedna supports popular AI frameworks, such as TensorFlow, Pytorch, PaddlePaddle, MindSpore.

Sedna can simply enable edge-cloud synergy capabilities to existing training and inference scripts, bringing the benefits of reducing costs, improving model performance, and protecting data privacy.

Features

Sedna has the following features:

  • Provide the edge-cloud synergy AI framework.

    • Provide dataset and model management across edge-cloud, helping developers quickly implement synergy AI applications.
  • Provide edge-cloud synergy training and inference frameworks.

    • Joint inference: under the condition of limited resources on the edge, difficult inference tasks are offloaded to the cloud to improve the overall performance, keeping the throughput.
    • Incremental training: For small samples and non-iid data on the edge, models can be adaptively optimized over time on the cloud or edge.
    • Federated learning: For those scenarios that the data being too large, or unwilling to migrate raw data to the cloud, or high privacy protection requirements, models are trained at the edge and parameters are aggregated on the cloud to resolve data silos effectively.
    • Lifelong learning: Confronted with the challenge of heterogeneous data distributions in complex scenarios and small samples on the edge, the edge-cloud synergy lifelong learning:
      • leverages the cloud knowledge base which empowers the scheme with memory ability, which helps to continuously learn and accumulate historical knowledge to overcome the catastrophic forgetting challenge.
      • is essentially the combination of another two learning schemes, i.e., multi-task learning and incremental learning, so that it can learn unseen tasks with shared knowledge among various scenarios over time.
    • etc..
  • Compatibility

    • Compatible with mainstream AI frameworks such as TensorFlow, Pytorch, PaddlePaddle, and MindSpore.
    • Provides extended interfaces for developers to quickly integrate third-party algorithms, and some necessary algorithms for edge-cloud synergy have been preset, such as hard sample discovering, aggregation algorithm.

Architecture

Sedna’s edge-cloud synergy is implemented based on the following capabilities provided by KubeEdge:

  • Unified orchestration of across edge-cloud applications.
  • Router: across edge-cloud message channel in management plane.
  • EdgeMesh: across edge-cloud microservice discovery and traffic governance in data plane.

Component

Sedna consists of the following components:

GlobalManager

  • Unified edge-cloud synergy AI task management
  • Cross edge-cloud synergy management and collaboration
  • Central Configuration Management

LocalController

  • Local process control of edge-cloud synergy AI tasks
  • Local general management: model, dataset, and status synchronization

Worker

  • Do inference or training, based on existing ML framework.
  • Launch on demand, imagine they are docker containers.
  • Different workers for different features.
  • Could run on edge or cloud.

Lib

  • Expose the Edge AI features to applications, i.e. training or inference programs.

Guides

Documents

Documentation is located on readthedoc.io. These documents can help you understand Sedna better.

Installation

Follow the Sedna installation document to install Sedna.

Examples

Example1:Using Joint Inference Service in Helmet Detection Scenario.
Example2:Using Incremental Learning Job in Helmet Detection Scenario.
Example3:Using Federated Learning Job in Surface Defect Detection Scenario.
Example4:Using Federated Learning Job in YoLov5-based Object Detection.
Example5:Using Lifelong Learning Job in Thermal Comfort Prediction Scenario.
Example6:Using MultiEdge Inference Service to Track an Infected COVID-19 Carrier in Pandemic Scenarios.

Roadmap

Meeting

Regular Community Meeting:

Resources:

Contact

If you have questions, feel free to reach out to us in the following ways:

Contributing

If you’re interested in being a contributor and want to get involved in developing the Sedna code, please see CONTRIBUTING for details on submitting patches and the contribution workflow.

License

Sedna is under the Apache 2.0 license. See the LICENSE file for details.