Featured

AWS DL (Deep Learning) Containers: Rapidly Deploy Custom Machine Learning Environments

Published

2 years ago

April 11, 2019

AWS recently released a service called AWS DL Containers aimed at deep learning researchers. The service involves pre-configuring and validating Docker images and then pre-installing them with deep learning frameworks that can be used to deploy custom ML environments in a rapid manner.

AWS DL Containers currently support Apache MXNet and TensorFlow, but will keep adding more frameworks like Facebook’s PyTorch. Unveiled at the Santa Clara AWS Summit in March 2019, DL Containers can be used for inferencing and training purposes. They’re the company’s response to EKS and ECS users’ call to AWS to create a simple way to deploy TensorFlow workloads to the cloud.

Support for more services will follow, per AWS Chief Evangelist Jeff Barr. He also said that the images would be made available for free, and can be used pre-configured, or customized to suit the needs of the workload by adding packages and libraries.

There are several types of AWS DL Containers available, all of which are based on combinations of the following criteria:

Framework – TensorFlow or MXNet.
Mode – Training or Inference. You can train on a single node or on a multi-node cluster.
Environment – CPU or GPU.
Python Version – 2.7 or 3.6.
Distributed Training – Availability of the Horovod framework.
Operating System – Ubuntu 16.04.

How to Use Amazon Deep Learning Containers

The setup part is fairly simple. In the example shown by Barr, the user creates an ECS cluster with an instance like p2.8xlarge, as shown below:

$ aws ec2 run-instances –image-id ami-0ebf2c738e66321e6
–count 1 –instance-type p2.8xlarge
–key-name keys-jbarr-us-east …

Next check that the cluster is running and that the ECS Container Agent is active, and create a text file for task definition:

{
“requiresCompatibilities”: [
“EC2”
],
“containerDefinitions”: [
{
“command”: [
“tensorflow_model_server –port=8500 –rest_api_port=8501 –model_name=saved_model_half_plus_two_gpu –model_base_path=/models/saved_model_half_plus_two_gpu”
],
“entryPoint”: [
“sh”,
“-c”
],
“name”: “EC2TFInference”,
“image”: “841569659894.dkr.ecr.us-east-1.amazonaws.com/sample_tf_inference_images:gpu_with_half_plus_two_model”,
“memory”: 8111,
“cpu”: 256,
“resourceRequirements”: [
{
“type”: “GPU”,
“value”: “1”
}
],
“essential”: true,
“portMappings”: [
{
“hostPort”: 8500,
“protocol”: “tcp”,
“containerPort”: 8500
},
{
“hostPort”: 8501,
“protocol”: “tcp”,
“containerPort”: 8501
},
{
“containerPort”: 80,
“protocol”: “tcp”
}
],
“logConfiguration”: {
“logDriver”: “awslogs”,
“options”: {
“awslogs-group”: “/ecs/TFInference”,
“awslogs-region”: “us-east-1”,
“awslogs-stream-prefix”: “ecs”
}
}
}
],
“volumes”: [],
“networkMode”: “bridge”,
“placementConstraints”: [],
“family”: “Ec2TFInference”
}

The task definition is then registered using container specs like Mode and Environment, and the revision number is captured. In this case, 3:

The task definition and revision number are then used to create a service, after which you can navigate to the task in the console and find the external binding for port 8501.

After training the model on the function y=ax+b, with a being 0.5 and b being 2, inferences can be run for 1.0, 2.0 and 5.0 as inputs, and the predicted values will be 2.5, 3.0 and 4.5.

$ curl -d ‘{“instances”: [1.0, 2.0, 5.0]}’
-X POST http://xx.xxx.xx.xx:8501/v1/models/saved_model_half_plus_two_gpu:predict
{
“predictions”: [2.5, 3.0, 4.5
]
}

The example Barr gave was intended to show users how easy it is to perform inferencing using the new DL Containers service and a pre-trained model. The flexible nature of the service allows users to launch a training model, do the training and then run inferences.

The big cloud players are now introducing ready-to-deploy frameworks and hardware acceleration. Google announced TensorFlow 2.0 alpha for its GCP, and Microsoft and NVIDIA recently announced some key integrations:

“By integrating NVIDIA TensorRT with ONNX Runtime and RAPIDS with Azure Machine Learning service, we’ve made it easier for machine learning practitioners to leverage NVIDIA GPUs across their data science workflows,” according to Kari Briski, Senior Director of Product Management for Accelerated Computing Software at NVIDIA.

AWS Deep Learning Containers is the latest addition to the broad and deep list of services aimed at data scientists and deep learning researchers. They’re available through Amazon ECR at no cost, as is the case with most of their free services that only charge you for resource usage.

Source: https://1reddrop.com/2019/04/11/aws-dl-deep-learning-containers-rapidly-deploy-custom-machine-learning-environments/?utm_source=rss&utm_medium=rss&utm_campaign=aws-dl-deep-learning-containers-rapidly-deploy-custom-machine-learning-environments

Related Topics:Amazon blockchain environment

Up Next

White House Sets The Most Unclear and Ambiguous AI Goal Yet

Don't Miss

Patent Applications per Country

Blockchain

Boson Protocol concludes $25.8M public sale, token listed on exchanges

Published

6 hours ago

April 12, 2021

Republished by Plato

Boson Protocol, a decentralized commerce (dCommerce) ecosystem using NFTs encoded with game theory, announced today that it has successfully raised $25.8 million in its public token sale, bringing the total funds raised by the company to $36 million. Boson has also announced the listing of the BOSON token on a number of cryptocurrency exchanges, including Bitfinex, Kucoin, and Gate.io, enabling traders to access its ecosystem and play an active role in the advancement of decentralized commerce.

This news follows Boson Protocol’s recent $10 million USD raise in private investment rounds which placed it amongst the highest-raising NFT projects to date. These private rounds saw participation from several high-profile and upcoming VCs, DAOs, and industry players including Outlier Ventures, FBG, Rarestone Capital, TRG Capital, Duck DAO, and Animoca Brands.

“Our goal from the beginning was to create a decentralized, open, and fairer future for commerce. Though it may be easy and convenient to shop online, the current system separates people and companies from the value they create, harvesting their data for the benefit of a small number of internet monopolies. Boson Protocol was created to replace that system. I am incredibly grateful to our team, our supporters, our investors, and most of all, our community, for taking us one step closer to achieving this goal. We are blown away by the support we have received from so many, and we are incredibly excited to make our vision of a global decentralized ecosystem for commerce transactions a reality. We are creating the building blocks that will underpin a swarm of specialized applications to disrupt, de-monopolize, and democratize commerce.”
– Justin Banon, CEO, and Co-Founder of Boson Protocol

Boson Protocol will allow people, companies, and machines to transact in a decentralized manner, with minimized arbitration, cost, and friction. The BOSON token is the native utility token for the protocol and will be used to incentivize actions across the ecosystem.

This is the latest in a string of notable announcements from Boson Protocol, including recently-announced partnerships with companies such as Ocean Protocol, Eidoo, Royale Finance, Gather Network, Bridge Mutual, and Orion Protocol.

Boson Protocol is a web 3.0 primitive that acts as the foundational infrastructure to connect smart contracts with real-world commerce and its data to power the decentralized autonomous commerce revolution. Through Commitment NFTs, Boson Protocol allows for future trade commitments to be tokenized, enabling enterprises, organizations, and customers to bridge the divide between digital decentralized technologies and the transfer and trade of physical goods.

Source: bosonprotocol.io

Coinsmart. Beste Bitcoin-Börse in Europa
Source: https://www.cryptoninjas.net/2021/04/13/boson-protocol-concludes-25-8m-public-sale-token-listed-on-exchanges/

Blockchain

Once-In-A-Lifetime Chance to Appear in a Grammy-Nominated Platinum Recording Artist’s NFT Release: Worth Millions, or Billions?

Published

1 day ago

April 11, 2021

Republished by Plato

Advertisement & &

This unique NFT launch includes exclusive experiences for fans to be able to participate in a music video and win a personalized “Dubplate”, which means that a winners’ name is included in the lyrics of the song.

Auction ends today, April 11 @ 5:00PM EST – Owens.Market

Darrin Campo, an NYU professor, stated in a recent article that NFTs should be considered within the lifetime value of an artist’s work and may, in fact, be worth billions, not millions:

“We have an idea of the lifetime value of a Picasso, Lord of the Rings, and Star Wars. Why would any creator leave so much money on the table? Talent is a rare commodity in this world, but money is not. Money can be created easily, in a Federal Reserve Zoom meeting. But a hit song? A masterpiece? Or simply a song or picture that you like? That’s priceless.” — Darren Campo, NYU Professor, TV Producer, and Science Fiction Author

Owens.Market

Advertisement & &

Graphical user interface, application Description automatically generated

Coinsmart. Beste Bitcoin-Börse in Europa
Source: https://zycrypto.com/once-in-a-lifetime-chance-to-appear-in-a-grammy-nominated-platinum-recording-artists-nft-release-worth-millions-or-billions/

Blockchain

DEX liquidity provider PancakeSwap now available on SWFT Blockchain

Published

4 days ago

April 8, 2021

Republished by Plato

SWFT Blockchain, a cross-chain exchange protocol, has announced that PancakeSwap has been integrated as a liquidity provider. A whole new world of cryptocurrencies and DeFi is now available for SWFT Blockchain users thanks to this update.

The update means that swapping to Binance Smart Chain (BSC) cryptocurrencies is now easier than ever. Before this update, any BSC currency listed on SWFT Blockchain had to be first listed on a centralized exchange. Now, that is no longer the case.

BSC

For BSC token projects, this means that they can now open direct doors with hundreds of cryptocurrencies on dozens of blockchains.

For SWFT Blockchain users, it means that if their favorite assets are only available on Binance Smart Chain or, more specifically, on PancakeSwap, they can now swap them to their favorite assets on other chains and back.

SWFT Blockchain users will now be able to swap from any supported asset on any supported chain directly to most assets on BSC. Because of this, the SWFT Blockchain team expects the number of BSC assets available on SWFT Blockchain to grow exponentially in the next few months,

Coinsmart. Beste Bitcoin-Börse in Europa
Source: https://www.cryptoninjas.net/2021/04/09/dex-liquidity-provider-pancakeswap-now-available-on-swft-blockchain/