MediaTypes

Template

• Representation
  
  
  • aspects of representation
  
  
• Operations
  
  
  • categories of operations

Types

• Media type Non-temporal: Text
  
  
  • Representation
    
    
    • ASCII, ISO character sets
      
    • Marked-up, structured text
      
    • Hypertext
    
    
  • Operations
    
    
    • Operations: character, string, language-specific
      
    • Editing, formatting
      
    • Pattern-matching and searching
      
    • Sorting
      
    • Compression
      
    • Encryption
  
  
• Media type Non-temporal: Image
  
  
  • Representation
    
    
    • Color model: CIE, RGB, HSB, CMYK, YUV
      
    • Channels: alpha?, number, depth
      
    • Interlacing
      
    • Indexing
      
    • Pixel aspect ration
      
    • Compression
    
    
  • Operations
    
    
    • Editing
      
    • Point operations: thresholding, color correction
      
    • Filtering
      
    • Compositing
      
    • Geometric transformations: displacing, rotating, mirroring, scaling, skewing, warping
      
    • Conversion: color separation, resampling
  
  
• Media type Non-temporal: Graphics
  
  
  • Representation
    
    
    • Geometric models (used in GKS, PHIGS, PEX)
      
    • Solid models: constructive solid geometry, surfaces of revolution, extrusion
      
    • Physically based models (considering mass, velocity, rigidity)
      
    • Empirical models: fractals, particle systems
      
    • Drawing models: PostScript, LOGO graphics
      
    • External formats for models: CGM, Render-Man Interface Binary (RIB)
      
    
    
  • Operations
    
    
    • Primitive editing: for objects, of vertex coordinates, surface normals
      
    • Structural editing: creating, modifying, spatial relationships
      
    • Shading: flat, Gouraud, Phong, ray tracing, radiosity, programmable shaders
      
    • Mapping: texture mapping, bump mapping, displacement mapping, environment mapping, shadow mapping
      
    • Lighting: ambient light, point lights, directional lights, spot lights
      
    • Viewing: 2 or 3D, parallel and perspective projections
      
    • Rendering: converts a model (shading, lighting, viewing info) into an image
  
  
• Media type Temporal: Analog video
  
  
  • Representation
    
    
    • Frame rate
      
    • Number of scan lines
      
    • Aspect ratio, e.g., 4:3
      
    • Interlacing, e.g., 2:1 fields per frame
      
    • Quality, e.g., signal-to-noise ratio and image resolution
      
    • Component versus composite
    
    
  • Operations
    
    
    • Storage: Tapes -- Type B or C, Betacam, U-matic, Hi8, S-VHS, VHS; Videodisc
      
    • Retrieval: based on time codes
      
    • Synchronization: avoid timebase jitter and timebase phase shift using sync generator, genlock, timebase corrector
      
    • Editing: cuts-only editing, A-B roll editing, edit decision list (EDL)
      
    • Mixing: cut, fade, dissolve (cross-fade), wipe, tumble, wrapping, keying
      
    • Conversion: scan converter, standards conversion
  
  
• Media type Temporal: Digital video
  
  
  • Representation
    
    
    • Analog formats sampled: CCIR 601, digital composite, CIF, QCIF, digital HDTV; synthesis, sampling
      
    • Sampling rate
      
    • Sample size and quantization: linear, logarithmic
      
    • Data rate
      
    • Frame rate: 10, 15, 25, 30
      
    • Compression
      
    • Support for interactivity
      
    • Scalability: transmit scalability, receive scalability
    
    
  • Operations
    
    
    • Storage
      
    • Retrieval
      
    • Synchronization
      
    • Editing: tape based, nonlinear
      
    • Effects
      
    • Conversion
  
  
• Media type Temporal: Digital audio
  
  
  • Representation
    
    
    • Sampling frequency
      
    • Sample size and quantization: linear, nonlinear
      
    • Number of channels (tracks): 2, 4, 16, 32
      
    • Interleaving
      
    • Negative samples: one or two's complement
      
    • Encoding: PCM, ADPCM
    
    
  • Operations
    
    
    • Storage
      
    • Retrieval
      
    • Editing: cross-fade, play list
      
    • Effects and filtering: delay, equalization, normalization, noise reduction, time compression/expansion, pitch shifting, stereoization, acoustic environments
      
    • Conversion
  
  
• Media type Temporal: Music
  
  
  • Representation
    
    
    • Operational versus symbolic
      
    • MIDI
      
    • SMDL: Standard Music Description Language (SGML)
    
    
  • Operations
    
    
    • Playback and synthesis
      
    • Timing
      
    • Editing and composition
  
  
• Media type Temporal: Animation
  
  
  • Representation
    
    
    • Cel models: celluloid sheets
      
    • Scene-based models
      
    • Event-based models
      
    • Keyframes
      
    • Articulated objects and hierarchical models
      
    • Scripting and procedural models
      
    • Physically based and empirical models
    
    
  • Operations
    
    
    • Graphics
      
    • Motion and parameter control
      
    • Animation rendering
      
    • Animation playback
  
  
• Media type Other: Extended Images
  
• Media type Other: Digital ink
  
• Media type Other: Speech audio
  
• Media type Temporal: Animation

Hierarchy

• Home: Table of Contents
• More General: Lecture 7
• Previous: IMA
• Next: Objects+
• More Detail: ---