Yioop - PHP Search Engine

May 5 In-Class Exercise Thread.

Post your solution to the May 5 In-Class Exercise Thread.

Best,

Chris

Post your solution to the May 5 In-Class Exercise Thread. Best, Chris

-- May 5 In-Class Exercise Thread

Resource Description for in_class_exercise_12_queue.PNG

Initial queue (site, money ever received, money since last crawled):
0) (s1,10,10) (s2,10,10)
--- crawl s1, discover s2 and s5
1) (s1,10,10-10= 0) (s2,10+5= 15,10+5= 15) (s5,0+5= 5,0+5= 5)
--- crawl s2, discover s3 and s5
2) (s1,10,0) (s2,15,15-15= 0) (s3,0+7.5= 7.5,0+7.5= 7.5) (s5,5+7.5= 12.5,5+7.5= 12.5)
--- crawl s5, discover s1
3) (s1,10,0+6.25 = 6.25) (s2,15,0) (s3,7.5,7.5) (s5,12.5,12.5-12.5= 0)
--- crawl s3, discover s4 and s5
4) (s1,10,6.25) (s2,15,0) (s3,7.5,7.5-7.5= 0) (s4,0+3.75= 3.75, 0+3.75= 3.75) (s5,12.5,0+3.75= 3.75)
--- crawl s1, discover s2 and s5
5) (s1,10,6.25-6.25= 0) (s2,15,0+3.125= 3.125) (s3,7.5,0) (s4,3.75,3.75) (s5,12.5,3.75+3.125= 6.875)
--- crawl s5, discover s1
6) (s1,10,0+3.4375= 3.4375) (s2,15,0+3.125= 3.125) (s3,7.5,0) (s4,3.75,3.75) (s5,12.5,6.875-6.875= 0)
--- crawl s4, discover s1 and s5
7) (s1,10,3.4375+1.875= 5.3125) (s2,15,0+3.125= 3.125) (s3,7.5,0) (s4,3.75,3.75-3.75= 0) (s5,12.5,0+1.875= 1.975)

We have now successfully crawled all 5 pages, so we can stop.

(Edited: 2021-05-05)

((resource:in_class_exercise_12_queue.PNG|Resource Description for in_class_exercise_12_queue.PNG)) Initial queue (site, money ever received, money since last crawled): 0) (s1,10,10) (s2,10,10) --- crawl s1, discover s2 and s5 1) (s1,10,10-10= 0) (s2,10+5= 15,10+5= 15) (s5,0+5= 5,0+5= 5) --- crawl s2, discover s3 and s5 2) (s1,10,0) (s2,15,15-15= 0) (s3,0+7.5= 7.5,0+7.5= 7.5) (s5,5+7.5= 12.5,5+7.5= 12.5) --- crawl s5, discover s1 3) (s1,10,0+6.25 = 6.25) (s2,15,0) (s3,7.5,7.5) (s5,12.5,12.5-12.5= 0) --- crawl s3, discover s4 and s5 4) (s1,10,6.25) (s2,15,0) (s3,7.5,7.5-7.5= 0) (s4,0+3.75= 3.75, 0+3.75= 3.75) (s5,12.5,0+3.75= 3.75) --- crawl s1, discover s2 and s5 5) (s1,10,6.25-6.25= 0) (s2,15,0+3.125= 3.125) (s3,7.5,0) (s4,3.75,3.75) (s5,12.5,3.75+3.125= 6.875) --- crawl s5, discover s1 6) (s1,10,0+3.4375= 3.4375) (s2,15,0+3.125= 3.125) (s3,7.5,0) (s4,3.75,3.75) (s5,12.5,6.875-6.875= 0) --- crawl s4, discover s1 and s5 7) (s1,10,3.4375+1.875= 5.3125) (s2,15,0+3.125= 3.125) (s3,7.5,0) (s4,3.75,3.75-3.75= 0) (s5,12.5,0+1.875= 1.975) We have now successfully crawled all 5 pages, so we can stop.

-- May 5 In-Class Exercise Thread

Let's say we start with S1 and S2 having value 10 dollars each initially.

The format used within the Queue is Site: (money in last crawl, money from all crawls)

Queue: {S1: (10, 10), S2: (10, 10)}
```
  Crawl: S1 (10 dollars) -> S2, S5
```
Queue: {S2: (15, 15), S5: (5, 5), S1: (0, 10)}
```
  Crawl: S2 (15 dollars) -> S3, S5
```
Queue: {S5: (12.5, 12.5), S3: (7.5, 7.5), S2: (0, 15), S1: (0, 10)}
```
  Crawl: S5 (12.5 dollars) -> S1
```
Queue: {S1: (12.5, 22.5), S3: (7.5, 7.5), S2: (0, 15), S5: (0, 12.5)}
```
  Crawl: S1 (12.5 dollars) -> S2, S5
```
Queue: {S3: (7.5, 7.5), S2: (6.25, 21.25), S5: (6.25, 18.75), S1: (0, 22.5)}
```
  Crawl: S3 (7.5 dollars) -> S4, S5
```
Queue: {S5: (10, 22.5), S2: (6.25, 21.25), S4: (3.75, 3.75), S1: (0, 22.5), S3: (0, 7.5)}
```
  Crawl: S5 (10 dollars) -> S1
```
Queue: {S1: (10, 32.5), S2: (6.25, 21.25), S4: (3.75, 3.75), S5: (0, 22.5), S3: (0, 7.5)}
```
  Crawl: S1 (10 dollars) -> S2, S5
```
Queue: {S2: (11.25, 26.25), S5: (5, 27.5), S4: (3.75, 3.75), S1: (0, 32.5), S3: (0, 7.5)}
```
  Crawl: S2 (11.25 dollars) -> S3, S5
```
Queue: {S5: (10.625, 33.125), S3: (5.625, 13.125), S4: (3.75, 3.75), S1: (0, 32.5), S2: (0, 26.25)}
```
  Crawl: S5 (10.625 dollars) -> S1
```
Queue: {S1: (10.625, 43.125), S3: (5.625, 13.125), S4: (3.75, 3.75), S5: (0, 33.125), S2: (0, 26.25)}
```
  Crawl: S1 (10.625 dollars) -> S2, S5
```
Queue: {S3: (5.625, 13.125), S5: (5.3125, 38.4375), S2: (5.3125, 31.5625), S4: (3.75, 3.75), S1: (0, 43.125)}
```
  Crawl: S3 (5.625 dollars) -> S4, S5
```
Queue: {S5: (8.125, 41.25), S4: (6.5625, 6.5625), S2: (5.3125, 31.5625), S1: (0, 43.125), S3: (0, 13.125)}
```
  Crawl: S5 (8.125 dollars) -> S1
```
Queue: {S1: (8.125, 51.25), S4: (6.5625, 6.5625), S2: (5.3125, 31.5625), S5: (0, 41.25), S3: (0, 13.125)}
```
  Crawl: S1 (8.125 dollars) -> S2, S5
```
Queue: {S2: (9.375, 35.625), S4: (6.5625, 6.5625), S5: (4.0625, 45.3125), S1: (0, 51.25), S3: (0, 13.125)}
```
  Crawl: S2 (9.375 dollars) -> S3, S5
```
Queue: {S5: (8.75, 50), S4: (6.5625, 6.5625), S3: (4.6875, 17.8125), S1: (0, 51.25), S2: (0, 35.625)}
```
  Crawl: S5 (8.75 dollars) -> S1
```
Queue: {S1: (8.75, 60), S4: (6.5625, 6.5625), S3: (4.6875, 17.8125), S5: (0, 50), S2: (0, 35.625)}
```
  Crawl: S1 (8.75 dollars) -> S2, S5
```
Queue: {S4: (6.5625, 6.5625), S3: (4.6875, 17.8125), S5: (4.375, 50), S2: (4.375, 35.625), S1: (0, 60)}
```
  Crawl: S4 (6.5625 dollars) -> S1, S5
```
Queue: {S5: (7.65625, 53.28125), S3: (4.6875, 17.8125), S2: (4.375, 35.625), S1: (3.28125, 63.28125), S4: (0, 6.5625)}

We have now crawled each site at least once.

(Edited: 2021-05-10)

Let's say we start with S1 and S2 having value 10 dollars each initially. The format used within the Queue is Site: (money in last crawl, money from all crawls) * Queue: {S1: (10, 10), S2: (10, 10)} Crawl: S1 (10 dollars) -> S2, S5 * Queue: {S2: (15, 15), S5: (5, 5), S1: (0, 10)} Crawl: S2 (15 dollars) -> S3, S5 * Queue: {S5: (12.5, 12.5), S3: (7.5, 7.5), S2: (0, 15), S1: (0, 10)} Crawl: S5 (12.5 dollars) -> S1 * Queue: {S1: (12.5, 22.5), S3: (7.5, 7.5), S2: (0, 15), S5: (0, 12.5)} Crawl: S1 (12.5 dollars) -> S2, S5 * Queue: {S3: (7.5, 7.5), S2: (6.25, 21.25), S5: (6.25, 18.75), S1: (0, 22.5)} Crawl: S3 (7.5 dollars) -> S4, S5 * Queue: {S5: (10, 22.5), S2: (6.25, 21.25), S4: (3.75, 3.75), S1: (0, 22.5), S3: (0, 7.5)} Crawl: S5 (10 dollars) -> S1 * Queue: {S1: (10, 32.5), S2: (6.25, 21.25), S4: (3.75, 3.75), S5: (0, 22.5), S3: (0, 7.5)} Crawl: S1 (10 dollars) -> S2, S5 * Queue: {S2: (11.25, 26.25), S5: (5, 27.5), S4: (3.75, 3.75), S1: (0, 32.5), S3: (0, 7.5)} Crawl: S2 (11.25 dollars) -> S3, S5 * Queue: {S5: (10.625, 33.125), S3: (5.625, 13.125), S4: (3.75, 3.75), S1: (0, 32.5), S2: (0, 26.25)} Crawl: S5 (10.625 dollars) -> S1 * Queue: {S1: (10.625, 43.125), S3: (5.625, 13.125), S4: (3.75, 3.75), S5: (0, 33.125), S2: (0, 26.25)} Crawl: S1 (10.625 dollars) -> S2, S5 * Queue: {S3: (5.625, 13.125), S5: (5.3125, 38.4375), S2: (5.3125, 31.5625), S4: (3.75, 3.75), S1: (0, 43.125)} Crawl: S3 (5.625 dollars) -> S4, S5 * Queue: {S5: (8.125, 41.25), S4: (6.5625, 6.5625), S2: (5.3125, 31.5625), S1: (0, 43.125), S3: (0, 13.125)} Crawl: S5 (8.125 dollars) -> S1 * Queue: {S1: (8.125, 51.25), S4: (6.5625, 6.5625), S2: (5.3125, 31.5625), S5: (0, 41.25), S3: (0, 13.125)} Crawl: S1 (8.125 dollars) -> S2, S5 * Queue: {S2: (9.375, 35.625), S4: (6.5625, 6.5625), S5: (4.0625, 45.3125), S1: (0, 51.25), S3: (0, 13.125)} Crawl: S2 (9.375 dollars) -> S3, S5 * Queue: {S5: (8.75, 50), S4: (6.5625, 6.5625), S3: (4.6875, 17.8125), S1: (0, 51.25), S2: (0, 35.625)} Crawl: S5 (8.75 dollars) -> S1 * Queue: {S1: (8.75, 60), S4: (6.5625, 6.5625), S3: (4.6875, 17.8125), S5: (0, 50), S2: (0, 35.625)} Crawl: S1 (8.75 dollars) -> S2, S5 * Queue: {S4: (6.5625, 6.5625), S3: (4.6875, 17.8125), S5: (4.375, 50), S2: (4.375, 35.625), S1: (0, 60)} Crawl: S4 (6.5625 dollars) -> S1, S5 * Queue: {S5: (7.65625, 53.28125), S3: (4.6875, 17.8125), S2: (4.375, 35.625), S1: (3.28125, 63.28125), S4: (0, 6.5625)} We have now crawled each site at least once.

-- May 5 In-Class Exercise Thread

Priority Queue

S1 - 10 - 10

S2 - 10 - 10

Crawl S1

Priority Queue

S2 - 15 - 15

S5 - 5 - 5

S1 - 10 - 0

Crawl S2

Priority Queue

S5 - 12.5 - 12.5

S3 - 7.5 - 7.5

S1 - 10 - 0

S2 - 15 - 0

Crawl S5

Priority Queue

S1 - 12.5

S3 - 7.5

S2 - 0

S5 - 0

Crawl S1

Priority Queue

S3 - 7.5

S2 - 6.25

S5 - 6.25

S1 - 0

Crawl S3

Priority Queue

S5 - 10

S2 - 6.25

S4 - 3.75

S1 - 0

S3 - 0

Crawl S5

Priority Queue

S1 - 10

S2 - 6.25

S4 - 3.75

S3 - 0

S5 - 0

Crawl S1

Priority Queue

S2 - 11.25

S4 - 3.75

S5 - 5

S3 - 0

S1 - 0

Crawl S2

Priority Queue

S5 - 10.625

S3 - 5.625

S4 - 3.75

S1 - 0

S2 - 0

Crawl S5

Priority Queue

S1 - 10.625

S3 - 5.625

S4 - 3.75

S2 - 0

S5 - 0

Crawl S1

Priority Queue

S5 - 8.125

S4 - 6.5625

S3 - 5.625

S2 - 5.3125

S1 - 0

Crawl S5

Priority Queue

S1 - 8.125

S4 - 6.5625

S3 - 5.625

S2 - 5.3125

S5 - 0

Crawl S1

Priority Queue

S2 - 9.375

S4 - 6.5625

S3 - 5.625

S5 - 4.0625

S1 - 0

Crawl S2

Priority Queue

S3 - 10.3125

S5 - 8.75

S4 - 6.5625

S1 - 0

S2 - 0

Crawl S3

Priority Queue

S5 - 13.90625

S4 - 11.71875

S1 - 0

S2 - 0

S3 - 0

Crawl S5

Priority Queue

S1 - 13.90625

S4 - 11.71875

S2 - 0

S3 - 0

S5 - 0

Crawl S1

Priority Queue

S4 - 11.71875

S2 - 6.953125

S5 - 6.953125

S3 - 0

S1 - 0

Crawl S4

Priority Queue

S5 - 12.8125

S2 - 6.953125

S1 - 5.859375

S3 - 0

S4 - 0

(Edited: 2021-05-05)

Priority Queue S1 - 10 - 10 S2 - 10 - 10 Crawl S1 Priority Queue S2 - 15 - 15 S5 - 5 - 5 S1 - 10 - 0 Crawl S2 Priority Queue S5 - 12.5 - 12.5 S3 - 7.5 - 7.5 S1 - 10 - 0 S2 - 15 - 0 Crawl S5 Priority Queue S1 - 12.5 S3 - 7.5 S2 - 0 S5 - 0 Crawl S1 Priority Queue S3 - 7.5 S2 - 6.25 S5 - 6.25 S1 - 0 Crawl S3 Priority Queue S5 - 10 S2 - 6.25 S4 - 3.75 S1 - 0 S3 - 0 Crawl S5 Priority Queue S1 - 10 S2 - 6.25 S4 - 3.75 S3 - 0 S5 - 0 Crawl S1 Priority Queue S2 - 11.25 S4 - 3.75 S5 - 5 S3 - 0 S1 - 0 Crawl S2 Priority Queue S5 - 10.625 S3 - 5.625 S4 - 3.75 S1 - 0 S2 - 0 Crawl S5 Priority Queue S1 - 10.625 S3 - 5.625 S4 - 3.75 S2 - 0 S5 - 0 Crawl S1 Priority Queue S5 - 8.125 S4 - 6.5625 S3 - 5.625 S2 - 5.3125 S1 - 0 Crawl S5 Priority Queue S1 - 8.125 S4 - 6.5625 S3 - 5.625 S2 - 5.3125 S5 - 0 Crawl S1 Priority Queue S2 - 9.375 S4 - 6.5625 S3 - 5.625 S5 - 4.0625 S1 - 0 Crawl S2 Priority Queue S3 - 10.3125 S5 - 8.75 S4 - 6.5625 S1 - 0 S2 - 0 Crawl S3 Priority Queue S5 - 13.90625 S4 - 11.71875 S1 - 0 S2 - 0 S3 - 0 Crawl S5 Priority Queue S1 - 13.90625 S4 - 11.71875 S2 - 0 S3 - 0 S5 - 0 Crawl S1 Priority Queue S4 - 11.71875 S2 - 6.953125 S5 - 6.953125 S3 - 0 S1 - 0 Crawl S4 Priority Queue S5 - 12.8125 S2 - 6.953125 S1 - 5.859375 S3 - 0 S4 - 0

-- May 5 In-Class Exercise Thread

+-------------+---------------+------------+------------+----------------+---------------+ | visit site# | site 1 | site 2 | site 3 | site 4 | site 5 | +-------------+---------------+------------+------------+----------------+---------------+ | 0 | 10, 10 | 10, 10 | | | | | 1 | 0, 10 | 15, 15 | | | 5, 5 | | 2 | 0, 10 | 0, 15 | 7.5, 7.5 | | 12.5, 12.5 | | 5 | 12.5, 12.5 | 0, 15 | 7.5, 7.5 | | 0, 12.5 | | 1 | 0, 12.5 | 6.25, 15 | 7.5, 7.5 | | 6.25, 12.5 | | 3 | 0, 12.5 | 6.25, 15 | 0, 7.5 | 3.75, 3.75 | 10, 12.5 | | 5 | 10, 12.5 | 6.25, 15 | 0, 7.5 | 3.75, 3.75 | 0, 12.5 | | 1 | 0, 12.5 | 11.25, 15 | 0, 7.5 | 3.75, 3.75 | 5, 12.5 | | 2 | 0, 12.5 | 0, 15 | 5.625, 7.5 | 3.75, 3.75 | 10.625, 12.5 | | 5 | 10.625, 12.5 | 0, 15 | 5.625, 7.5 | 3.75, 3.75 | 0, 12.5 | | 1 | 0, 12.5 | 5.3125, 15 | 5.625, 7.5 | 3.75, 3.75 | 5.3125, 12.5 | | 3 | 0, 12.5 | 5.3125, 15 | 0, 7.5 | 6.5625, 6.5625 | 8.125, 12.5 | | 5 | 4.0625, 12.5 | 5.3125, 15 | 0, 7.5 | 6.5625, 6.5625 | 0, 12.5 | | 4 | 7.34375, 12.5 | 5.3125, 15 | 0, 7.5 | 0, 6.5625 | 3.28125, 12.5 | +-------------+---------------+------------+------------+----------------+---------------+

(Edited: 2021-05-05)

<nowiki> +-------------+---------------+------------+------------+----------------+---------------+ | visit site# | site 1 | site 2 | site 3 | site 4 | site 5 | +-------------+---------------+------------+------------+----------------+---------------+ | 0 | 10, 10 | 10, 10 | | | | | 1 | 0, 10 | 15, 15 | | | 5, 5 | | 2 | 0, 10 | 0, 15 | 7.5, 7.5 | | 12.5, 12.5 | | 5 | 12.5, 12.5 | 0, 15 | 7.5, 7.5 | | 0, 12.5 | | 1 | 0, 12.5 | 6.25, 15 | 7.5, 7.5 | | 6.25, 12.5 | | 3 | 0, 12.5 | 6.25, 15 | 0, 7.5 | 3.75, 3.75 | 10, 12.5 | | 5 | 10, 12.5 | 6.25, 15 | 0, 7.5 | 3.75, 3.75 | 0, 12.5 | | 1 | 0, 12.5 | 11.25, 15 | 0, 7.5 | 3.75, 3.75 | 5, 12.5 | | 2 | 0, 12.5 | 0, 15 | 5.625, 7.5 | 3.75, 3.75 | 10.625, 12.5 | | 5 | 10.625, 12.5 | 0, 15 | 5.625, 7.5 | 3.75, 3.75 | 0, 12.5 | | 1 | 0, 12.5 | 5.3125, 15 | 5.625, 7.5 | 3.75, 3.75 | 5.3125, 12.5 | | 3 | 0, 12.5 | 5.3125, 15 | 0, 7.5 | 6.5625, 6.5625 | 8.125, 12.5 | | 5 | 4.0625, 12.5 | 5.3125, 15 | 0, 7.5 | 6.5625, 6.5625 | 0, 12.5 | | 4 | 7.34375, 12.5 | 5.3125, 15 | 0, 7.5 | 0, 6.5625 | 3.28125, 12.5 | +-------------+---------------+------------+------------+----------------+---------------+ </nowiki>

-- May 5 In-Class Exercise Thread

Resource Description for OPIC1.png Resource Description for OPIC2.png

((resource:OPIC1.png|Resource Description for OPIC1.png)) ((resource:OPIC2.png|Resource Description for OPIC2.png))

-- May 5 In-Class Exercise Thread

Format: (site, money last crawl, money all crawls)

Initial (20 dollars)

Queue = {(S1, 10, 10), (S2, 10, 10)}

Crawl S1 (10 dollars) -> S2, S5

Queue = {(S2, 15, 15), (S5, 5, 5), (S1, 0, 10)}

Crawl S2 (15 dollars) -> S3, S5

Queue = {(S5, 12.5, 12.5), (S3, 7.5, 7.5), (S2, 0, 15), (S1, 0, 10)}

Crawl S5 (12.5 dollars) -> S1

Queue = {(S1, 12.5, 22.5), (S3, 7.5, 7.5), (S2, 0, 15), (S5, 0, 12.5)}

Crawl S1 (12.5 dollars) -> S2, S5

Queue = {(S3, 7.5, 7.5), (S2, 6.25, 21.25), (S5, 6.25, 18.75), (S1, 0, 22.5)}

Crawl S3 (7.5 dollars) -> S4, S5

Queue = {(S5, 10, 22.5), (S2, 6.25, 21.25), (S4, 3.75, 3.75), (S1, 0, 22.5), (S3, 0, 7.5)}

Crawl S5 (10 dollars) -> S1

Queue = {(S1, 10, 32.5), (S2, 6.25, 21.25), (S4, 3.75, 3.75), (S5, 0, 22.5), (S3, 0, 7.5)}

Crawl S1 (10 dollars) -> S2, S5

Queue = {(S2, 11.25, 26.25), (S5, 5, 27.5), (S4, 3.75, 3.75), (S1, 0, 32.5), (S3, 0, 7.5)}

Crawl S2 (11.25 dollars) -> S3, S5

Queue = {(S5, 10.625, 33.125), (S3, 5.625, 13.125), (S4, 3.75, 3.75), (S1, 0, 32.5), (S2, 0, 26.25)}

Crawl S5 (10.625 dollars) -> S1

Queue = {(S1, 10.625, 43.125), (S3, 5.625, 13.125), (S4, 3.75, 3.75), (S5, 0, 33.125), (S2, 0, 26.25)}

Crawl S1 (10.625 dollars) -> S2, S5

Queue = {(S3, 5.625, 13.125), (S5, 5.3125, 38.4375), (S2, 5.3125, 31.5625), (S4, 3.75, 3.75), (S1, 0, 43.125)}

Crawl S3 (5.625 dollars) -> S4, S5

Queue = {(S5, 8.125, 41.25), (S4, 6.5625, 6.5625), (S2, 5.3125, 31.5625), (S1, 0, 43.125), (S3, 0, 13.125)}

Crawl S5 (8.125 dollars) -> S1

Queue = {(S1, 8.125, 51.25), (S4, 6.5625, 6.5625), (S2, 5.3125, 31.5625), (S5, 0, 41.25), (S3, 0, 13.125)}

Crawl S1 (8.125 dollars) -> S2, S5

Queue = {(S2, 9.375, 35.625), (S4, 6.5625, 6.5625), (S5, 4.0625, 45.3125), (S1, 0, 51.25), (S3, 0, 13.125)}

Crawl S2 (9.375 dollars) -> S3, S5

Queue = {(S5, 8.75, 50), (S4, 6.5625, 6.5625), (S3, 4.6875, 17.8125), (S1, 0, 51.25), (S2, 0, 35.625)}

Crawl S5 (8.75 dollars) -> S1

Queue = {(S1, 8.75, 60), (S4, 6.5625, 6.5625), (S3, 4.6875, 17.8125), (S5, 0, 50), (S2, 0, 35.625)}

Crawl S1 (8.75 dollars) -> S2, S5

Queue = {(S4, 6.5625, 6.5625), (S3, 4.6875, 17.8125), (S5, 4.375, 50), (S2, 4.375, 35.625), (S1, 0, 60)}

Crawl S4 (6.5625 dollars) -> S1, S5

Queue = {(S5, 7.65625, 53.28125), (S3, 4.6875, 17.8125), (S2, 4.375, 35.625), (S1, 3.28125, 63.28125), (S4, 0, 6.5625)}

And now we have crawled each site at least once.

(Edited: 2021-05-07)

Format: (site, money last crawl, money all crawls) Initial (20 dollars) Queue = {(S1, 10, 10), (S2, 10, 10)} Crawl S1 (10 dollars) -> S2, S5 Queue = {(S2, 15, 15), (S5, 5, 5), (S1, 0, 10)} Crawl S2 (15 dollars) -> S3, S5 Queue = {(S5, 12.5, 12.5), (S3, 7.5, 7.5), (S2, 0, 15), (S1, 0, 10)} Crawl S5 (12.5 dollars) -> S1 Queue = {(S1, 12.5, 22.5), (S3, 7.5, 7.5), (S2, 0, 15), (S5, 0, 12.5)} Crawl S1 (12.5 dollars) -> S2, S5 Queue = {(S3, 7.5, 7.5), (S2, 6.25, 21.25), (S5, 6.25, 18.75), (S1, 0, 22.5)} Crawl S3 (7.5 dollars) -> S4, S5 Queue = {(S5, 10, 22.5), (S2, 6.25, 21.25), (S4, 3.75, 3.75), (S1, 0, 22.5), (S3, 0, 7.5)} Crawl S5 (10 dollars) -> S1 Queue = {(S1, 10, 32.5), (S2, 6.25, 21.25), (S4, 3.75, 3.75), (S5, 0, 22.5), (S3, 0, 7.5)} Crawl S1 (10 dollars) -> S2, S5 Queue = {(S2, 11.25, 26.25), (S5, 5, 27.5), (S4, 3.75, 3.75), (S1, 0, 32.5), (S3, 0, 7.5)} Crawl S2 (11.25 dollars) -> S3, S5 Queue = {(S5, 10.625, 33.125), (S3, 5.625, 13.125), (S4, 3.75, 3.75), (S1, 0, 32.5), (S2, 0, 26.25)} Crawl S5 (10.625 dollars) -> S1 Queue = {(S1, 10.625, 43.125), (S3, 5.625, 13.125), (S4, 3.75, 3.75), (S5, 0, 33.125), (S2, 0, 26.25)} Crawl S1 (10.625 dollars) -> S2, S5 Queue = {(S3, 5.625, 13.125), (S5, 5.3125, 38.4375), (S2, 5.3125, 31.5625), (S4, 3.75, 3.75), (S1, 0, 43.125)} Crawl S3 (5.625 dollars) -> S4, S5 Queue = {(S5, 8.125, 41.25), (S4, 6.5625, 6.5625), (S2, 5.3125, 31.5625), (S1, 0, 43.125), (S3, 0, 13.125)} Crawl S5 (8.125 dollars) -> S1 Queue = {(S1, 8.125, 51.25), (S4, 6.5625, 6.5625), (S2, 5.3125, 31.5625), (S5, 0, 41.25), (S3, 0, 13.125)} Crawl S1 (8.125 dollars) -> S2, S5 Queue = {(S2, 9.375, 35.625), (S4, 6.5625, 6.5625), (S5, 4.0625, 45.3125), (S1, 0, 51.25), (S3, 0, 13.125)} Crawl S2 (9.375 dollars) -> S3, S5 Queue = {(S5, 8.75, 50), (S4, 6.5625, 6.5625), (S3, 4.6875, 17.8125), (S1, 0, 51.25), (S2, 0, 35.625)} Crawl S5 (8.75 dollars) -> S1 Queue = {(S1, 8.75, 60), (S4, 6.5625, 6.5625), (S3, 4.6875, 17.8125), (S5, 0, 50), (S2, 0, 35.625)} Crawl S1 (8.75 dollars) -> S2, S5 Queue = {(S4, 6.5625, 6.5625), (S3, 4.6875, 17.8125), (S5, 4.375, 50), (S2, 4.375, 35.625), (S1, 0, 60)} Crawl S4 (6.5625 dollars) -> S1, S5 Queue = {(S5, 7.65625, 53.28125), (S3, 4.6875, 17.8125), (S2, 4.375, 35.625), (S1, 3.28125, 63.28125), (S4, 0, 6.5625)} And now we have crawled each site at least once.

-- May 5 In-Class Exercise Thread

((resource:IMG_1544.jpg|Resource Description for IMG_1544.jpg))

-- May 5 In-Class Exercise Thread

 site = (money ever received, money since last crawl)

 1. S1 = (10,10)  
    S2 = (10,10)

 2. crawl S1 ---> discover S2 and S5
    S1 = (10, 10 - 10) = (10, 0)    
    S2 = (10 + 5 , 10 + 5) = (15, 15)
    S5 = (0 + 5, 0 + 5) = (5, 5)

 3. Max S2, so crawl S2 -----> discover S3 and S5
    S1 = (10, 0)
    S2 = (15 , 15 - 15) = (15 ,0)
    S3 = (0 + 7.5, 0 + 7.5) = (7.5, 7.5)
    S5 = (5 + 7.5, 5 + 7.5) = (12.5, 12.5)

 4. Max S5, So crawl S5 ----> discover S1
    S1 = (10 + 12.5, 0 + 12.5) = (22.5, 12.5)
    S2 = (15, 0)
    S3 = (7.5, 7.5)
    S5 = (12.5, 12.5 - 12.5) = (12.5, 0)
 
 5. Max S1, So crawl S1 ---> discover S2 and S5
    S1 = (22.5, 12.5 - 12.5) = (22.5, 0)
    S2 = (15 + 6.25, 0 + 6.25) = (21.25, 6.25)
    S3 = (7.5, 7.5)
    S5 = (12.5 + 6.25, 0 + 6.25) = (18.75, 6.25)

 6. Max S3, So crawl S3 ----> discover S4 and S5
    S1 = (22.5, 0) 
    S2 = (21.25, 6.25)
    S3 = (7.5, 7.5 - 7.5) = (7.5, 0)
    S4 = (0 + 3.75, 0 + 3.75) = (3.75, 3.75)
    S5 = (18.75 + 3.75, 6.25 + 3.75) = (22.5, 10)

 7. Max S5, So crawl S5-----> discover S1
    S1 = (22.5 + 10, 0 + 10) = (32.5, 10)
    S2 = (21.25, 6.25)
    S3 = (7.5, 0)
    S4 = (3.75, 3.75)
    S5 = (22.5, 10) = (22.5, 0)

 8. Max S1, So crawl S1 ----> discover S2 and S5
    S1 = (32.5, 10 - 10) = (32.5, 0)
    S2 = (21.25 + 5, 6.25 + 5) = (26.25, 11.25)
    S3 = (7.5, 0)
    S4 = (3.75, 3.75)
    S5 = (22.5 + 5, 0 + 5) = (27.5, 5)

 9. Max S2, So crawl S2 ----> discover S3 and S5
    S1 = (32.5, 0)
    S2 = (26.25, 11.25 - 11.25) = (26.25, 0)
    S3 = (7.5 + 5.625, 0 + 5.625) = (13.125, 5.625)
    S4 = (3.75, 3.75)
    S5 = (27.5 + 5.625, 5 + 5.625) = (33.125, 10.625)

 10. Max S5, So crawl S5 -------> discover S1
    S1 = (32.5 + 10.625, 0 + 10.625) = (43.125, 10.625)
    S2 = (26.25, 0)
    S3 = (13.125, 5.625)
    S4 = (3.75, 3.75)
    S5 = (33.125, 10.625 - 10.625) = (33.125, 0)

 11. Max S1, So crawl S1 -----> discover S2 and S5
    S1 = (43.125, 10.625 - 10.625) = (43.125, 0)
    S2 = (26.25 + 5.3125, 0 + 5.3125) = (31.56, 5.3125)
    S3 = (13.125, 5.625)
    S4 = (3.75, 3.75)
    S5 = (33.125 + 5.3125, 0 + 5.3125) = (38.437, 5.3125)

 12. Max S3, So crawl S3 -----> discover S5 and S4
    S1 = (43.125, 0) 
    S2 = (31.56, 5.3125)
    S3 = (13.125, 5.625 - 5.625) = (13.125, 0)
    S4 = (3.75 + 2.8125, 3.75 + 2.8125) = (6.5625, 6.5625)
    S5 = (38.437 + 2.8125, 5.3125 + 2.8125) = (41.249, 8.125)

 13. Max S5, So crawl S5 -----> discover S1
    S1 = (43.125 + 8.125, 0 + 8.125) = (51.25, 8.125)
    S2 = (31.56, 5.3125)
    S3 = (13.125, 0)
    S4 = (6.5625, 6.5625)
    S5 = (41.249, 8.125 - 8.125) = (41.249, 0)
 
 14. Max S1, So crawl S1 -----> discover S2 and S5
    S1 = (51.25, 8.125 - 8.125) = (51.25, 0)
    S2 = (31.56 + 4.062, 5.3125 + 4.062) = (35.62, 9.3745)
    S3 = (13.125, 0)
    S4 = (6.5625, 6.5625)
    S5 = (41.249 + 4.062, 0 + 4.062) = (45.311, 4.062)

 15. Max S2, So crawl S2 -----> discover S3 and S5
    S1 = (51.25, 0) 
    S2 = (35.62, 9.3745 - 9.3745) = (35.62, 0)
    S3 = (13.125 + 4.687, 0 + 4.687) = (17.8125, 4.687)
    S4 = (6.5625, 6.5625)
    S5 = (45.311 + 4.687, 4.062 + 4.687) = (49.998, 8.749)
 
 16. Max S5, So crawl S5 -----> discover S1
    S1 = (51.25 + 8.749, 0 + 8.749) = (59.999, 8.749)
    S2 = (35.62, 0)
    S3 = (17.8125, 4.687)
    S4 = (6.5625, 6.5625)
    S5 = (49.998, 8.749 - 8.749) = (49.998, 0)
 
 17. Max S1, So crawl S1 -----> discover S2 and S5
    S1 = (59.999, 8.749 - 8.749) = (60 , 0)
    S2 = (35.62 + 4.374, 0 + 4.374) = (40 , 4.374)
    S3 = (17.8125, 4.687)
    S4 = (6.5625, 6.5625)
    S5 = (49.998+ 4.374, 0+ 4.374) = (54.374, 4.374)

 18. Max S4, So crawl S4 -----> discover S1 and S5
    S1 = (60 , 0 + 3.28125) = (60, 3.28125)
    S2 = (40 , 4.374)
    S3 = (17.8125, 4.687)
    S4 = (6.5625, 6.5625 - 6.5625) = (6.5625, 0)
    S5 = (54.374 + 3.28125, 4.374 + 3.28125) = (57.655, 7.655)

Now each site is crawled at least once

site = (money ever received, money since last crawl) 1. S1 = (10,10) S2 = (10,10) 2. crawl S1 ---> discover S2 and S5 S1 = (10, 10 - 10) = (10, 0) S2 = (10 + 5 , 10 + 5) = (15, 15) S5 = (0 + 5, 0 + 5) = (5, 5) 3. Max S2, so crawl S2 -----> discover S3 and S5 S1 = (10, 0) S2 = (15 , 15 - 15) = (15 ,0) S3 = (0 + 7.5, 0 + 7.5) = (7.5, 7.5) S5 = (5 + 7.5, 5 + 7.5) = (12.5, 12.5) 4. Max S5, So crawl S5 ----> discover S1 S1 = (10 + 12.5, 0 + 12.5) = (22.5, 12.5) S2 = (15, 0) S3 = (7.5, 7.5) S5 = (12.5, 12.5 - 12.5) = (12.5, 0) 5. Max S1, So crawl S1 ---> discover S2 and S5 S1 = (22.5, 12.5 - 12.5) = (22.5, 0) S2 = (15 + 6.25, 0 + 6.25) = (21.25, 6.25) S3 = (7.5, 7.5) S5 = (12.5 + 6.25, 0 + 6.25) = (18.75, 6.25) 6. Max S3, So crawl S3 ----> discover S4 and S5 S1 = (22.5, 0) S2 = (21.25, 6.25) S3 = (7.5, 7.5 - 7.5) = (7.5, 0) S4 = (0 + 3.75, 0 + 3.75) = (3.75, 3.75) S5 = (18.75 + 3.75, 6.25 + 3.75) = (22.5, 10) 7. Max S5, So crawl S5-----> discover S1 S1 = (22.5 + 10, 0 + 10) = (32.5, 10) S2 = (21.25, 6.25) S3 = (7.5, 0) S4 = (3.75, 3.75) S5 = (22.5, 10) = (22.5, 0) 8. Max S1, So crawl S1 ----> discover S2 and S5 S1 = (32.5, 10 - 10) = (32.5, 0) S2 = (21.25 + 5, 6.25 + 5) = (26.25, 11.25) S3 = (7.5, 0) S4 = (3.75, 3.75) S5 = (22.5 + 5, 0 + 5) = (27.5, 5) 9. Max S2, So crawl S2 ----> discover S3 and S5 S1 = (32.5, 0) S2 = (26.25, 11.25 - 11.25) = (26.25, 0) S3 = (7.5 + 5.625, 0 + 5.625) = (13.125, 5.625) S4 = (3.75, 3.75) S5 = (27.5 + 5.625, 5 + 5.625) = (33.125, 10.625) 10. Max S5, So crawl S5 -------> discover S1 S1 = (32.5 + 10.625, 0 + 10.625) = (43.125, 10.625) S2 = (26.25, 0) S3 = (13.125, 5.625) S4 = (3.75, 3.75) S5 = (33.125, 10.625 - 10.625) = (33.125, 0) 11. Max S1, So crawl S1 -----> discover S2 and S5 S1 = (43.125, 10.625 - 10.625) = (43.125, 0) S2 = (26.25 + 5.3125, 0 + 5.3125) = (31.56, 5.3125) S3 = (13.125, 5.625) S4 = (3.75, 3.75) S5 = (33.125 + 5.3125, 0 + 5.3125) = (38.437, 5.3125) 12. Max S3, So crawl S3 -----> discover S5 and S4 S1 = (43.125, 0) S2 = (31.56, 5.3125) S3 = (13.125, 5.625 - 5.625) = (13.125, 0) S4 = (3.75 + 2.8125, 3.75 + 2.8125) = (6.5625, 6.5625) S5 = (38.437 + 2.8125, 5.3125 + 2.8125) = (41.249, 8.125) 13. Max S5, So crawl S5 -----> discover S1 S1 = (43.125 + 8.125, 0 + 8.125) = (51.25, 8.125) S2 = (31.56, 5.3125) S3 = (13.125, 0) S4 = (6.5625, 6.5625) S5 = (41.249, 8.125 - 8.125) = (41.249, 0) 14. Max S1, So crawl S1 -----> discover S2 and S5 S1 = (51.25, 8.125 - 8.125) = (51.25, 0) S2 = (31.56 + 4.062, 5.3125 + 4.062) = (35.62, 9.3745) S3 = (13.125, 0) S4 = (6.5625, 6.5625) S5 = (41.249 + 4.062, 0 + 4.062) = (45.311, 4.062) 15. Max S2, So crawl S2 -----> discover S3 and S5 S1 = (51.25, 0) S2 = (35.62, 9.3745 - 9.3745) = (35.62, 0) S3 = (13.125 + 4.687, 0 + 4.687) = (17.8125, 4.687) S4 = (6.5625, 6.5625) S5 = (45.311 + 4.687, 4.062 + 4.687) = (49.998, 8.749) 16. Max S5, So crawl S5 -----> discover S1 S1 = (51.25 + 8.749, 0 + 8.749) = (59.999, 8.749) S2 = (35.62, 0) S3 = (17.8125, 4.687) S4 = (6.5625, 6.5625) S5 = (49.998, 8.749 - 8.749) = (49.998, 0) 17. Max S1, So crawl S1 -----> discover S2 and S5 S1 = (59.999, 8.749 - 8.749) = (60 , 0) S2 = (35.62 + 4.374, 0 + 4.374) = (40 , 4.374) S3 = (17.8125, 4.687) S4 = (6.5625, 6.5625) S5 = (49.998+ 4.374, 0+ 4.374) = (54.374, 4.374) 18. Max S4, So crawl S4 -----> discover S1 and S5 S1 = (60 , 0 + 3.28125) = (60, 3.28125) S2 = (40 , 4.374) S3 = (17.8125, 4.687) S4 = (6.5625, 6.5625 - 6.5625) = (6.5625, 0) S5 = (54.374 + 3.28125, 4.374 + 3.28125) = (57.655, 7.655) Now each site is crawled at least once

-- May 5 In-Class Exercise Thread

Resource Description for IMG_20210508_234109.jpg

((resource:IMG_20210508_234052.jpg|Resource Description for IMG_20210508_234052.jpg)) ((resource:IMG_20210508_234109.jpg|Resource Description for IMG_20210508_234109.jpg))