CMPE 250: Multimedia Systems

Fall 08

Instructor Roberto Manduchi
Class Hours: M-W 5-6:45 pm
Room: BE 156
Office: E2 327
Office Hours: By appointment
Email: manduchi@soe

[Home] [Calendar] [Assignments] [Project]

Announcements

  • 12/8 - There was an error in the solution of Homework 5, Exercise 2. I re-posted it with the correct solution.
  • 12/5 - The remaining project demonstrations will be given in my Lab at E2 301 (third floor of the E2 building) beginning at 5 pm.
  • 12/5 - There is not going to be a 6th homework!
  • 11/28 - The 5th Homework is out.
  • 11/19 - Please email me a quick project update, vis-a-vis the timeline in your proposal.
  • 11/13 - The 4th Homework is out.
  • 11/13 - Beginning Monday, November 17, lectures will start at the regular time (5 pm)
  • 11/6 - I changed the date for the project demo. Projects will be demonstrated on Wednesday, December 3rd and Monday, December 8th.
  • 10/30 - The 3rd Homework is out.
  • 10/27
    • Here is a PPT template for your project proposal presentation of October 29.
    • The midterm will be given on November 10.
    • Demo day is set for December 5.
  • 10/21 - In order to make up for the two missing lectures of last week, the lectures from Monday, October 27 to Wednesday, November 12 will begin at 4:45 pm and end at 6:45 pm. Thanks for your patience and understanding!
  • 10/21 - The 2nd Homework is out.
  • 10/2 - The 1st Homework is out!
  • Welcome to CMPE 250! Announcements related to the course will be posted here. Please check this page frequently.

Web Archive

Recorded lectures can be accessed here.

General Description

  • This class covers the broad area of networked multimedia systems. Topics covered include:
    • Multimedia formats:
      • Audio (MP-3, AAC)
      • Images (JPEG, JPEG-2000)
      • Video (MPEG-*, H26*)
    • Color imaging
    • HDTV
    • Media streaming over the Internet
    • VoIP, videoconferencing

  • Here is the detailed calendar of the course.

  • Textbook:
    • The class notes are the only required reading, along with specialized technical papers that will be listed in the class notes.
    • The following book are good references:
      • Z-N. Li, M.S. Drew, Fundamental of Multimedia, Pearson/Prentice Hall, 2004
      • Y. Wang, J. Ostermann, Y. Zhang, Video Processing and Communications, Prentice Hall, 2002
      • D. Taubman and M. Marcellin, JPEG 2000: Image Compression Fundamentals, Standards and Practice, Kluwer International Series in Engineering and Computer Science, 2002.
      • T. Ebrahimi, F. Pereira, The MPEG-4 Book , Prentice Hall, 2002.
      • M. Bosi, R. Goldberg, Introduction to Digital Audio Coding and Standards, Kluwer Academic Publishing, 2003
      • A. Spanias, T. Painter, V. Atti, Audio Signal Processing and Coding, Wiley-Interscience, 1997

  • Grading:
    • Midterm (TBD): 40%
    • Final (Dec. 9, 4-6 pm): 40%
    • Project: 20%
    • The Homework will be reviewed but not graded. You need to complete all exercises and return it in class at the scheduled time. 5% of your grade will be deducted for each homework you fail to turn in, to a maximum of 20%.


All students enrolling in this class are advised that Academic Integrity for undergraduate and graduate students will be strictly enforced.

If you qualify for classroom accommodations because of a disability, please get an Accommodation Authorization from the Disability Resource Center (DRC) and submit it to me in person outside of class (e.g., office hours) within the first two weeks of the quarter. Contact DRC at 459-2089 (voice), 459-4806 (TTY), or drc.ucsc.edu for more information on the requirements and/or process.

Calendar

WEEK 1 9/29 Introduction
Basics of signal processing		 PDF,PPT
10/1 Basics of signal processing (cont'd)
WEEK 2 10/6 Basics of signal processing (cont'd)
10/8 Basics of compression theory
WEEK 3 10/13 No class
10/15 No class
WEEK 4 10/20 Basics of compression theory (cont'd) PDF,PPT
10/22 Introduction to audio compression PDF,PPT
WEEK 5 10/27 Introduction to audio compression (cont'd)
Audio compression standards		 PDF,PPT The official MPEG page
The AC-3 standard (from Dolby Laboratories)
An open-source MP-3 codec (the LAME project)
 An article on the history of multichannel film sound
Surround Sound Past, Present, and Future (from Dolby Laboratories)
An article on 3-D sound by Chris Kyriakakis
10/29 Proposal presentation
Audio compression standards (cont'd)
Speech coding		 PDF,PPT A tutorial review of speech coding by A. Spanias
WEEK 6 11/3 Proposal presentation (cont'd)
Color in multimedia		 PDF,PPT Here is a simple introduction to different imaging sensors
An article by Sharma and Trussell about color for multimedia
An article by Sakamoto et al. about color interpolation with Bayer patterns
11/5 Color in multimedia (cont'd)
Image dithering
WEEK 7 11/10 Midterm Covers all of the material up to and including Speech coding.
Closed books - no notes.
11/12 Color in multimedia (cont'd)
Image dithering		 PDF,PPT
An article by Ostromoukov and Hersch about color dithering
WEEK 8 11/17 Image compression formats: JPEG PDF,PPT An article by Wallace describing the JPEG standard
11/19 Image compression: JPEG 2000 An article by Taubman and Marcellin describing the JPEG-2000 standard
WEEK 9 11/24 Image and video formats PDF,PPT
11/26 Vido coding standards PDF,PPT
WEEK 10 12/1 Video coding standards (cont'd)
12/3 Demo day
12/8 Demo day
12/9 Final Exam

Assignments

Project

  • You will need to submit a 2-page proposal for your project by October 22 29, in which day you will present your proposal in class. Please discuss your project ideas with me before. In the project proposal you will need to specify:
    • Motivation: What is your final goal and how it relates to the class material.
    • Plan: How do you intend to solve your problem.
    • Deliverable: What will you show me on demo day.
    • Risks: What could go wrong during the project and what are your contingency plans.
    • Equipment: What equipment will be used and where do you plan to work for the project.

  • Here is a PPT template for your project proposal presentation

  • Demo dates are December 5 3 and December 8.

  • The idea is to build a project around a system (rather than a stand-alone application on your PC) and possibly processing image streams/video or audio in real time.
    • No Matlab projects.
    • No projects that simply implement an image processing/computer vision algorithm. These projects are suitable for EE264 or CE 264, but not for this course.

  • Here are but a few project ideas:
    • Build an application on a cell phone. You could use the Symbian OS (or Windows Mobile if you prefer) to create an application that allows you to capture and manipulate video or audio with a cell phone. For example, you could embed location data in a picture, or create a smart compression system that changes the compression quality depending on how much memory is left, or a smart sound recording/coding system that eliminates background noise. We have a number of Nokia cell phones that can be used for the project.
      • Requires: Climbing a somewhat steep learning curve as required for Symbian programming.
      • Here you can find some info about programming in Symbian (courtesy of Orazio)
    • Tinkering with MP-3. Play with an open source MP-3 encoder such as LAME, in order to experiment with different perceptual models. Or use a perceptual masking model to improve the quality and understandability of speech by increasing the gain in channels that would otherwise get masked.
      • Requires: Some signal processing background.
    • Building a Stargate network. We have a number of Intel Stargate boards that can be used for the project. A Stargate board has an XScale processor that runs embedded Linux, USB connector with drivers for a Logitech camera, 802.11 radio, Ethernet connector. You could build a small network of battery-operated wireless Stargate boards that take and relay images, for example for a surveillance application.
      • Requires: Familiarity with Linux and basic network programming.