Big data and cloud computing Weekly (of 101)

Disclaimer: This article is a blogger original article, shall not be reproduced without the bloggers allowed. https://blog.csdn.net/zNZQhb07Nr/article/details/89880078

Lead

"Big Data" in the name is actually a marketing language, from a technical point of view, contains a wide range, computing, storage, networks are involved, broad knowledge, learning difficulty is high.

This issue will give you the dedication wonderful: the Spring blown downgrade, AI , Hbase , CV, MongoDB, the Spark , micro-management services, Cassandra, . All dry goods, hope you like! ! !

# Big data and cloud computing communities # hope by insisting on a regular basis can help students to share power of microblogging on the road Big Data learning contribute. We believe long-term adherence to carefully read weekly students, will be increasingly sophisticated technology on the road! The long-term adherence to thank the editors! Also ask someone to continue a reward, community support, support for editors continued dedication to high-quality knowledge!

# Big data and cloud computing technology community # long-term recruitment of interested and involved in community editing operations classmates welcomed the end of the two-dimensional code scanning text links ( community work, gain knowledge and progress, as well as a red envelope oh ).

To remind, the end the surprise!

The following is the text, limited to public limited editorial standards, does not guarantee that everyone likes. ( If the link does not point to open the two-dimensional code, please thank you )

1 AI

What is AI AI do think what the future is kind of how.

https://mp.weixin.qq.com/s/omMwlbASRp6keXhEf3TDRw

2 the Spring blown downgrade

Spring Cloud Sentinel become official recommended the mainstream blown downgrade

https://mp.weixin.qq.com/s/unxm9VDzol8hNSfe-HUzqQ

3MongoDB

This article describes the types of locks used MongoDB, the lock granularity, and describes how to view the lock on state mongod instance, which will lock the database management commands, as well as the type of lock client operations will be taken;

http://www.mongoing.com/archives/25738

640?wx_fmt=png

Spark

Adopt a practical approach, showing how Spark analysis performed on the log scale semi-structured data log

https://mp.weixin.qq.com/s/0JJEGyMzMYddpV_kDPRIfg

5 micro-management services

With the development of business, scale, more and more services need to coordinate the various service lines running to ensure SLA services; capacity management KPI based performance data service call, the rational allocation of each service resource consumption; fault business doing service degradation, traffic control, traffic migration to quickly resume business.

https://mp.weixin.qq.com/s/Pv6Az5zNP4HSG6ugAWPTPg

6Cassandra

Apache Cassandra is an open source, distributed, no center, flexible scalability, high availability, fault tolerance, consistency adjustable row-oriented database, which Amazon Dynamo distributed design and data model based on Google Bigtable, created by Facebook , it has been applied in some of the most popular sites. This paper describes the Apache Cassandra

https://www.iteblog.com/archives/2530.html

640?wx_fmt=png

7Spark

使用Python做数据分析的同学肯定用过pandas库，Spark虽然包含机器学习很多算法，但其基于RDD的数据预处理方式很繁琐。本文介绍了Koalas ，它是一个新的开源项目，它增强了 PySpark 的 DataFrame API，使其与 pandas 兼容。

https://mp.weixin.qq.com/s/0HAK6kTA8-bQQRKL7h2nzA

8CV

计算机视觉技术在日常生活中有着非常普遍的应用：发朋友圈之前自动修图、网上购物时刷脸支付……在这一系列成功的应用背后，卷积神经网络功不可没。本文将介绍卷积神经网络背后的数学原理。

https://mp.weixin.qq.com/s/Fo3h9gTQMpO6G-SPnboSGQ

所谓脑启发的视觉计算就是从生物大脑的神经结构、认知机制、行为特性等多个层面寻求启发，引入神经科学、认知科学与心理学的先进成果，提出新的视觉计算模型与方法，克服当前模型与方法局限性，提升视觉计算的性能（准确性、鲁棒性、自适应性、可泛化性、可解释性等）。脑科学与视觉计算可以从如下两个方向加一结合，一是基于脑科学机制进行视觉计算的启发建模，二是现有服务于视觉计算的神经网络模型为脑启发机理提供分析和借鉴

https://mp.weixin.qq.com/s/rKHA2H4msHSInVn7A-fqHg

9Datax

使用Datax进行两个集群间的数据同步，在读取HDFS数据时，会出现数据丢失问题，本文针对数据丢失问题做出了分析以及对应解决方案，希望帮助大家在使用Datax过程中避免该问题的出现。

https://mp.weixin.qq.com/s/5O0adjnztvdSzorxHv9Aiw

10Hbase

推荐系统是驱动内容分发的引擎，而个性化则是推荐系统的核心思想。分类模型和排序模型是业界常用的两种个性化建模方式。本文探讨两种方法的异同点

https://mp.weixin.qq.com/s/nQmMvEPfeqnqQCDpPEctpw

11 Kaixinyike

Wake up, suddenly I wanted to go to the army, because the army's slogan is: Li earned, look to the money left to earn, earn the right to make thick, take the money, twelve million twelve million income interest rates, a beautiful day happy smile from start to mention the money I wish you and yours a happy 500 million.

Acknowledgments:

Zhou booming, King Road, Sun Yafei, Feng Yi-fan, CHEN Shao-jun, Deng opened the table, Zhang Shaohua, Xueshu Jiang, Liu Bin, Liu Chao, Liaocheng Peng, Dong Yan, Lucy Jin, Zhu Jie, with blue, Huang Wenhui, Guo Fei

Big data and cloud computing Weekly (of 101)

Guess you like