Microsoft Word - ece661_assignment_3_f19 ECE 661 Computer Vision Project #3 – Template matching In this project each student must implement a match spatial filter to recognize letters in an image of...

This should be done in octave using matlab programming without the use of any preprocessed and inbuilt functions.


Microsoft Word - ece661_assignment_3_f19 ECE 661 Computer Vision Project #3 – Template matching In this project each student must implement a match spatial filter to recognize letters in an image of text. The input image and ground truth file are supplied at the web site and should be used. The ground truth file lists all the letters and image pixel coordinates (cols, rows) of text in the image. The pixel coordinates are for the center point of each letter. Your program should perform template matching for five letters o, e, p, q, x. 1. Create template image matrices (M x N) for each letter. Start with the size of 13 x 9, then adjust accordingly for different letters. 2. Read the input image and ground truth files. 3. Calculate the matched-spatial filter (MSF) images (remember, this is not 8-bits). 4. Normalize the MSF image to 8-bits. 5. Loop through the following steps for a range of T: a. Threshold at T the normalized MSF image to create a binary image. b. Loop through the ground truth letter locations. i. Check a M x N pixel area centered at the ground truth location. If any pixel in the MSF image is greater than the threshold, consider the letter “detected”. If none of the pixels in the M x N area are greater than the threshold, consider the letter “not detected”. c. Categorize and count the detected letters as FP and TP. Calculate the TPR and FPR. 6. Create an ROC curve from the program output. You must write a brief report that includes the code and the ROC curve. Show your MSF images. Identify the optimal T for each letter and FPR and TPR at that threshold. Generate a cross confusion matrix for these five letters at each optimal T. P 39 25 r 47 25 e 55 25 p 64 25 a 72 25 r 80 25 a 89 25 t 97 25 i 105 25 o 114 25 n 122 25 f 139 25 o 147 25 r 155 25 p 172 25 a 180 25 r 189 25 e 197 25 n 205 25 t 214 25 h 222 25 o 230 25 o 239 25 d 247 25 i 264 25 s 272 25 n 289 25 o 297 25 t 305 25 j 322 25 u 330 25 s 339 25 t 347 25 a 364 25 m 381 25 a 389 25 t 397 25 t 406 25 e 414 25 r 422 25 o 439 25 f 447 25 r 464 25 e 472 25 a 481 25 d 489 25 i 497 25 n 506 25 g 514 25 b 531 25 o 539 25 o 547 25 k 556 25 s 564 25 a 581 25 n 589 25 d 597 25 d 39 41 e 47 41 c 55 41 o 64 41 r 72 41 a 80 41 t 89 41 i 97 41 n 105 41 g 114 41 t 130 41 h 139 41 e 147 41 n 164 41 u 172 41 r 180 41 s 189 41 e 197 41 r 205 41 y 214 41 H 247 41 e 255 41 r 264 41 e 272 41 a 289 41 r 297 41 e 305 41 s 322 41 o 330 41 m 339 41 e 347 41 t 364 41 e 372 41 s 381 41 t 389 41 s 397 41 f 414 41 o 422 41 r 431 41 e 447 41 x 456 41 p 464 41 e 472 41 c 481 41 t 489 41 a 497 41 n 506 41 t 514 41 p 531 41 a 539 41 r 547 41 e 556 41 n 564 41 t 572 41 s 581 41 t 597 41 o 606 41 t 39 58 a 47 58 k 55 58 e 64 58 t 80 58 o 89 58 p 105 58 r 114 58 e 122 58 p 130 58 a 139 58 r 147 58 e 155 58 t 172 58 h 180 58 e 189 58 m 197 58 s 205 58 e 214 58 l 222 58 v 230 58 e 239 58 s 247 58 f 264 58 o 272 58 r 280 58 t 297 58 h 305 58 e 314 58 r 330 58 e 339 58 a 347 58 l 356 58 l 372 58 i 381 58 f 389 58 e 397 58 e 414 58 x 422 58 p 431 58 e 439 58 r 447 58 i 456 58 e 464 58 n 472 58 c 481 58 e 489 58 o 506 58 f 514 58 b 531 58 e 539 58 i 547 58 n 556 58 g 564 58 a 581 58 m 39 75 o 47 75 t 55 75 h 64 75 e 72 75 r 80 75 o 97 75 r 105 75 f 122 75 a 130 75 t 139 75 h 147 75 e 155 75 r 164 75 C 64 108 a 72 108 n 80 108 y 97 108 o 105 108 u 114 108 s 130 108 t 139 108 a 147 108 n 155 108 d 164 108 t 180 108 h 189 108 e 197 108 m 214 108 e 222 108 s 230 108 s 239 108 c 255 108 h 264 108 i 272 108 l 280 108 d 289 108 r 297 108 e 305 108 n 314 108 m 330 108 a 339 108 k 347 108 e 356 108 T 389 108 o 397 108 f 414 108 i 422 108 n 431 108 d 439 108 o 456 108 u 464 108 t 472 108 s 497 108 m 506 108 e 514 108 a 522 108 r 531 108 p 547 108 e 556 108 a 564 108 n 572 108 u 581 108 t 589 108 b 39 125 u 47 125 t 55 125 t 64 125 e 72 125 r 80 125 o 97 125 n 105 125 t 114 125 o 122 125 t 139 125 h 147 125 e 155 125 s 172 125 o 180 125 f 189 125 a 197 125 a 214 125 n 222 125 d 230 125 j 247 125 a 255 125 m 264 125 o 280 125 n 289 125 t 297 125 o 305 125 t 322 125 h 330 125 e 339 125 c 356 125 u 364 125 r 372 125 t 381 125 a 389 125 i 397 125 n 406 125 s 414 125 H 447 125 i 456 125 d 464 125 e 472 125 a 489 125 f 506 125 i 514 125 s 522 125 h 531 125 f 547 125 i 556 125 n 564 125 g 572 125 e 581 125 r 589 125 b 39 141 e 47 141 h 55 141 i 64 141 n 72 141 d 80 141 t 97 141 h 105 141 e 114 141 s 130 141 t 139 141 e 147 141 r 155 141 e 164 141 o 172 141 a 189 141 n 197 141 d 205 141 l 222 141 e 230 141 a 239 141 v 247 141 e 255 141 i 272 141 t 280 141 t 297 141 h 305 141 e 314 141 r 322 141 e 330 141 a 347 141 l 356 141 l 364 141 s 381 141 u 389 141 m 397 141 m 406 141 e 414 141 r 422 141 S 456 141 t 464 141 i 472 141 c 481 141 k 489 141 y 506 141 o 514 141 u 522 141 r 531 141 f 547 141 i 556 141 n 564 141 g 572 141 e 581 141 r 589 141 s 597 141 i 614 141 n 622 141 t 39 158 h 47 158 e 55 158 f 72 158 l 80 158 o 89 158 w 97 158 e 105 158 r 114 158 b 122 158 e 130 158 d 139 158 s 147 158 t 164 158 h 172 158 e 180 158 n 189 158 r 205 158 u 214 158 b 222 158 t 239 158 h 247 158 e 255 158 m 264 158 o 280 158 n 289 158 t 305 158 h 314 158 e 322 158 c 339 158 l 347 158 e 356 158 a 364 158 n 372 158 w 389 158 a 397 158 l 406 158 l 414 158 s 422 158 C 456 158 o 464 158 v 472 158 e 481 158 r 489 158 t 506 158 h 514 158 e 522 158 s 539 158 t 547 158 a 556 158 i 564 158 n 572 158 s 581 158 w 597 158 i 606 158 t 614 158 h 622 158 c 39 174 r 47 174 a 55 174 y 64 174 o 72 174 n 80 174 s 89 174 H 122 174 o 130 174 w 139 174 d 155 174 o 164 174 e 172 174 s 180 174 t 197 174 h 205 174 a 214 174 t 222 174 l 239 174 o 247 174 o 255 174 k 264 174 D 64 208 r 72 208 e 80 208 s 89 208 s 97 208 i 105 208 n 114 208 g 122 208 s 139 208 m 147 208 a 155 208 l 164 208 l 172 208 c 189 208 h 197 208 i 205 208 l 214 208 d 222 208 r 230 208 e 239 208 n 247 208 i 264 208 s 272 208 n 289 208 o 297 208 t 305 208 a 322 208 s 330 208 e 347 208 a 356 208 s 364 208 y 372 208 a 389 208 s 397 208 i 414 208 t 422 208 s 439 208 e 447 208 e 456 208 m 464 208 s 472 208 F 506 208 i 514 208 r 522 208 s 531 208 t 539 208 b 556 208 u 564 208 y 572 208 a 589 208 n 597 208 o 39 224 c 47 224 t 55 224 o 64 224 p 72 224 u 80 224 s 89 224 a 105 224 n 114 224 d 122 224 a 139 224 s 155 224 t 164 224 r 172 224 i 180 224 n 189 224 g 197 224 b 214 224 a 222 224 g 230 224 A 264 224 t 272 224 t 280 224 e 289 224 m 297 224 p 305 224 t 314 224 t 330 224 o 339 224 p 356 224 u 364 224 t 372 224 t 389 224 h 397 224 e 406 224 o 422 224 c 431 224 t 439 224 o 447 224 p 456 224 u 464 224 s 472 224 i 489 224 n 497 224 t 506 224 o 514 224 t 531 224 h 539 224 e 547 224 s 564 224 t 572 224 r 581 224 i 589 224 n 597 224 g 606 224 b 39 241 a 47 241 g 55 241 s 72 241 o 80 241 t 97 241 h 105 241 a 114 241 t 122 241 n 139 241 o 147 241 n 155 241 e 164 241 o 180 241 f 189 241 t 205 241 h 214 241 e 222 241 a 239 241 r 247 241 m 255 241 s 264 241 h 280 241 a 289 241 n