- Programming MapReduce with Scalding
- Antonios Chalkiopoulos
- 223字
- 2021-12-08 12:44:20
Conventions
In this book, you will find a number of styles of text that distinguish between different kinds of information. Here are some examples of these styles, and an explanation of their meaning.
Code words in text, database table names, folder names, filenames, file extensions, pathnames, dummy URLs, and user input are shown as follows: "A Map class to map lines into <key,value>
pairs; for example, <"INFO",1>
."
A block of code is set as follows:
LogLine = load 'file.logs' as (level, message); LevelGroup = group LogLine by level; Result = foreach LevelGroup generate group, COUNT(LogLine); store Result into 'Results.txt';
When we wish to draw your attention to a particular part of a code block, the relevant lines or items are set in bold:
import com.twitter.scalding._
class CalculateDailyAdPoints (args: Args) extends Job(args) {
val logSchema = List ('datetime, 'user, 'activity, 'data,
'session, 'location, 'response, 'device, 'error, 'server)
val logs = Tsv("/log-files/2014/07/01", logSchema )
.read
.project('user,'datetime,'activity,'data)
.groupBy('user) { group => group.sortBy('datetime) }
.write(Tsv("/analysis/log-files-2014-07-01"))
}
Any command-line input or output is written as follows:
$ echo "This is a happy day. A day to remember" > input.txt $ hadoop fs -mkdir -p hdfs:///data/input hdfs:///data/output $ hadoop fs -put input.txt hdfs:///data/input/
New terms and important words are shown in bold.
Note
Warnings or important notes appear in a box like this.
Tip
Tips and tricks appear like this.
推薦閱讀
- Learning NServiceBus(Second Edition)
- Power Up Your PowToon Studio Project
- Apache Spark 2.x Machine Learning Cookbook
- OpenStack Cloud Computing Cookbook(Fourth Edition)
- Visual Basic學習手冊
- Mastering Predictive Analytics with Python
- Tableau 10 Bootcamp
- 一塊面包板玩轉Arduino編程
- OpenCV 3計算機視覺:Python語言實現(原書第2版)
- Mastering Concurrency in Python
- Neo4j 3.x入門經典
- 金融商業數據分析:基于Python和SAS
- ASP.NET本質論
- Visual C++程序開發范例寶典
- 三步學Python