Package net.paulhertz.pixelaudio.example

Class TutorialOne_05_GesturePlayground

java.lang.Object

processing.core.PApplet

net.paulhertz.pixelaudio.example.TutorialOne_05_GesturePlayground

All Implemented Interfaces:

processing.core.PConstants

public class TutorialOne_05_GesturePlayground
extends processing.core.PApplet

Uses a GUI to provide a tour of curve drawing with an interface to the two audio synthesis engines available in PixelAudio: the Sampler synth and the Granular synth.

QUICK START

1. Launch the sketch. A display window and a palette of Graphical User Interface (GUI) controls appears. The display window has an audio file preloaded. The grayscale values in the image are transcoded audio samples. An overlaid rainbow spectrum traces the "signal path", which maps an audio signal to the image pixels. The signal path is created by the PixelMapGen multigen and managed by the PixelAudioMapper mapper.
2. Drawing is already turned on, so go ahead and drag the mouse to draw a line. As in TutorialOne_03_Drawing, a brushstroke appears when you release the mouse. TutorialOne_03_Drawing gave you limited control over the attributes of the brushstroke and its associated audio parameters. In GesturePlayground, you can control nearly all the available parameters with the control palette.
3. At the top of the control palette, you'll find Path Source radio buttons and sliders for setting the geometry of the brush curve. When the curve is set to Reduced Points or Curve Points, the epsilon slider will allow you to visualize changes in the curve. For the curve points representation of the curve, the Curve Points slider will add or subtract subdivision points.
4. The GUI palette displays controls for the current audio synthesis instrument. Press the 't' key to change the instrument. The control palette will reflect the changes. The control palette provides three play modes: one for editing granular synthesis parameters, another for the sampler synthesizer, and a "play only" mode where you can play both instruments but don't have editing enabled.
5. The controls for the Sampler are fairly simple. You can change the number of points in the curve with the geometry controls. You can also change the duration of the gesture and the number of points in it with the Resample and Duration sliders. Finally, there's a Sampler Envelope menu that will change the ADSR envelope of each sampler event point.
6. The Granular Synth has all the controls of the Sampler synth except for the envelopes, plus many controls for granular synthesis:
   1. The Hop Mode radio buttons determine if the duration of the granular event is determined by the gesture timing data in the brushstroke's PACurveMaker instance, or by the Grain Length and Hop Length sliders.
   2. Burst Count sets the number of linear grains at each event point. Its effect is to expand the sound of each grain.
   3. Grain Length and Hop Length sliders control the spacing of the grains. Hop Length is only used for Fixed Hop Mode. Grain and Hop durations are in milliseconds.
   4. The Warp radio buttons and slider control non-linear timing changes to the gesture. Experiment to find out how they work.
7. There are many key commands too, including the 'o' command to load a new audio files. Some commands are particularly useful with granular synthesis:
   1. The 'q' command key will calculate the optimal number of grains in a gesture (usually in GESTURE Path Mode) and update the control palette. This can provide smooth granular synthesis even as it preserves the timing characteristic of the gesture.
   2. The 'c' command key will print configuration data to the console.
   3. The 'x' command key deletes the brush you are hovering over, if it is editable.
   4. The 'w' command key swaps the instrument type of the brush you are hovering over and changes edit mode to match.

About GesturePlayground

GesturePlayground uses a GUI to provide a tour of the usage and properties of the AudioBrush subclasses GranularBrush and SamplerBrush, the GestureSchedule class, and the Sampler and Granular audio synthesis instruments PASamplerInstrumentPool and PAGranularInstrumentDirector. An AudioBrush combines a PACurveMaker and a GestureGranularConfig.Builder. PACurveMaker models gestures, one of the core concepts of PixelAudio. In its simplest encoded form, the PAGesture interface, a gesture consists of an array of points and an array of times. The times array records the times when something as-yet-unspecified will happen at the corresponding point in the points array. The times array and the points array must be the same size.

In my demos for PixelAudio, what happens at a point is typically an audio event and an animation event. A very specific sound happens at every point in the bitmap image because bitmap locations map onto audio buffer indices with a one-to-one correspondence. The mapping is generated by a PixelMapGen instance and managed by a PixelMapper instance. Gestures over the 2D space of an image become paths through audio buffers. The audio buffer is accessed either by a granular synthesis engine or by a sampling synthesizer. For the granular synth, a gesture corresponds to a non-linear traversal of an audio buffer, potentially as a continuous sequence of overlapping grains with a single envelope. The sampling synthesizer treats each point as a discrete event with its own envelope. Depending on how gestures and schedules are structured, the two synthesizers can sound very similar, but there are possibilities in each that the other cannot realize. As you might expect, GranularBrush implements granular synth events and SamplerBrush implements sampler synth events. Both rely on PACUrveMaker which, in addition to capturing the raw gesture of drawing a line, provides methods to reduce points and times, create Bezier paths, and generate event schedules. PACurveMaker scheduling data can be modified by changing duration, interpolating samples, or by non-linear time warping. GesturePlayground uses GestureScheduleBuilder to interpolate and warp time and point lists.

The parameters for gesture modeling, granular and sampling synthesis, time and sample interpolation, and audio events are modeled in the GUI, which uses GestureGranularConfig.Builder gConfig to track its current state. A GestureGranularConfig instance is associated with each AudioBrush. When you click on an AudioBrush and activate it, its configuration data is loaded to the GUI and you can edit it. It will be saved to the brush when you select another brush or change the edit mode. When a brush is activated with a click, the schedule is built from its PACurveMaker and GestureGranularConfig.Builder instance variables:

GestureSchedule schedule = scheduleBuilder.build(gb.curve(), cfg.build(), audioOut.sampleRate());

Code Details

The calling chain for a GranularBrush:

• mouseClicked() calls scheduleGranularBrushClick(gb, x, y);.
• In scheduleGranularBrushClick(...) we get a reference to the audio buffer buf and then use the PACurveMaker object gb.curve() and gb.snapshot() to build a GestureSchedule, sched.
• sched gets timing and location information for the gesture from gb.curve() and modifies it with the settings from the control palette which are stored gb.snapshot().
• We port the granular synthesis parameters from the brush to a GestureGranularParams object, and then call playGranularGesture(buf, sched, gParams) to play the granular synth.
• We also call storeGranularCurveTL(...), which sets up UI animation events to track the grains.
• Parameter buf is the audio signal that is the source of our grains, parameter sched provides the points and times for grains and parameter, params provides the core parameters for granular synthesis.
• playGranularGesture() builds arrays for buffer position and pan for each individual grain and then calls gDir.playGestureNow(buf, sched, params, startIndices, panPerGrain) to play the PAGranularInstrumentDirector granular synth. The 'p' command key can toggle per-grain pitch jitter, which calls playGestureNow()in a slightly different way. See playGranularGesture() for details.
• PAGranularInstrumentDirector has its own calling chain that goes all the way down to the individual sample level using the Minim library's UGen interface. If you just want to play music, you'll probably never have to deal with the hierarchy of classes directly, but comments in PAGranularInstrumentDirector may be useful.

Part of the calling chain for a SamplerBrush:

• mouseClicked() calls scheduleSamplerBrushClick(sb, x, y).
• In scheduleSamplerBrushClick() we get array of points on the curve with getPathPoints(sb) and then use sb.snapshot() and scheduleBuilder.build() to build a GestureSchedule
• Finally, we pass the schedule and a small time offset to storeSamplerCurveTL(), an array of TimedLocation objects that is checked at every pass through the draw() loop and posts both Sampler instrument triggers and animation events. Unlike the Granular instrument, which requires very accurate timing, the Sampler synth requires less precision, so we can handle it through the UI frames. Sample-accurate timing is a topic for another as-yet-unreleased example sketch.
• The runSamplerBrushEvents() method executes the UI brushstroke animation and the Sampler audio events. Sampler events all pass through pool.playSample(samplePos, samplelen, amplitude, env, pitch, pan).

 KEY COMMANDS
 
 Press ' ' to spacebar triggers a brush if we're hovering over a brush, otherwise it triggers a point event.
 Press 'c' or 'C' to print the current configuration status to the console.
 Press 't' to switch between Granular and Sampler editing and playing.
 Press 'z' to change the drawing mode of the hover brush.
 Press 'd' to toggle doPlayOnDraw to play when a drawing gesture ends or not.
 Press 'p' to jitter the pitch of granular gestures.
 Press 'k' to apply the hue and saturation in the colors array to mapImage (not to baseImage).
 Press 'K' to apply hue and saturation in colors to baseImage and mapImage.
 Press 'l' or 'L' to toggle loading data to both image and audio buffers when you open either an image or an audio file.
 Press 'f' or 'F' to toggle verbose output to the console.
 Press 'o' to open an audio file.
 Press 'r' or 'R' to reset synths to defaults
 Press 'q' to automatically set an active GRANULAR brush to have an optimized number of samples.
 Press 's' to save display image to a PNG file.
 Press 'S' to save audio buffer to a .wav file.
 Press 'x' to delete the current active brush shape or the oldest brush shape.
 Press 'X' to delete the most recent brush shape.
 Press 'h' or 'H' to print help.
 

Note that animation is not enabled in this tutorial. See Bagatelle for a performance-oriented application with a GUI, presets, and networking.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
(package private) static final class	TutorialOne_05_GesturePlayground.ActiveDot
(package private) static class	TutorialOne_05_GesturePlayground.BrushHit	Simple container for a brush hit-test result.
(package private) static enum	TutorialOne_05_GesturePlayground.DrawingMode
(package private) static interface	TutorialOne_05_GesturePlayground.Happening	Future Development: Barebones interface for "something that happens at a certain point", and then in AudioScheduler the time-when-something-happens gets connected to the-room-where-it-happens and the entire cast of Hamilton steps in.
(package private) static final class	TutorialOne_05_GesturePlayground.SamplerPointHappening

Field Summary

Fields

Modifier and Type	Field	Description
private AudioBrush	activeBrush
(package private) GranularBrush	activeGranularBrush
(package private) int	activeGranularIndex
(package private) SamplerBrush	activeSamplerBrush
(package private) int	activeSamplerIndex
(package private) g4p_controls.GOption	allOption
ArrayList<processing.core.PVector>	allPoints
ArrayList<Integer>	allTimes
(package private) int	animatedCircleColor
(package private) int	animSteps
(package private) g4p_controls.GOption	arcLengthTimeOption
(package private) float	attackTime
private final AtomicLong	audioBlockStartSample
(package private) File	audioFile
(package private) int	audioFileLength
(package private) String	audioFileName
(package private) String	audioFilePath
(package private) String	audioFileTag
(package private) int	audioLength
private final AtomicLong	audioNextBlockStartSample
(package private) ddf.minim.AudioOutput	audioOut
(package private) AudioScheduler<TutorialOne_05_GesturePlayground.Happening>	audioSched
(package private) float[]	audioSignal
(package private) processing.core.PImage	baseImage
(package private) int	baselineCount
(package private) int	baselineDurationMs
(package private) float	bufferSampleRate
(package private) int	burstGrains
(package private) g4p_controls.GLabel	burstLabel
(package private) g4p_controls.GSlider	burstSlider
(package private) PixelAudioMapper.ChannelNames	chan
(package private) int	circleColor
(package private) int[]	colors
(package private) g4p_controls.GTextArea	commentsField
(package private) g4p_controls.GPanel	controlPanel
(package private) g4p_controls.GWindow	controlWindow
(package private) String	currentGranStatus
processing.core.PVector	currentPoint
(package private) static final int	CURVE_STEPS_FLOOR
(package private) static final int	CURVE_STEPS_HARD_MAX
(package private) static final int	CURVE_STEPS_SAFE_MAX
PACurveMaker	curveMaker
(package private) g4p_controls.GOption	curveOption
(package private) g4p_controls.GLabel	curvePointsLabel
(package private) g4p_controls.GSlider	curvePointsSlider
int	curveSteps
(package private) g4p_controls.GOption	customWarpOption
(package private) String	daFile
(package private) String	daPath
(package private) float	decayTime
(package private) final GestureGranularConfig.Builder	defaultGranConfig
(package private) float	defaultPitchScaling
(package private) final GestureGranularConfig.Builder	defaultSampConfig
(package private) int	dimCircleColor
(package private) int	dimLineColor
(package private) int	dimmedBrushColor
(package private) boolean	doPlayOnDraw
(package private) boolean	doResample
int	dragColor
float	dragWeight
(package private) TutorialOne_05_GesturePlayground.DrawingMode	drawingMode
(package private) g4p_controls.GTextField	durationField
(package private) g4p_controls.GLabel	durationLabel
(package private) g4p_controls.GSlider	durationSlider
(package private) static final String	ENV_CUSTOM
(package private) g4p_controls.GLabel	envelopeLabel
(package private) g4p_controls.GDropList	envelopeMenu
(package private) g4p_controls.GLabel	envelopeValuesLabel
(package private) boolean	envIsGranular
(package private) String[]	envPresetItems
float	epsilon
(package private) g4p_controls.GLabel	epsilonSliderLabel
(package private) int	eventStep
(package private) g4p_controls.GOption	expWarpOption
(package private) float	fileSampleRate
(package private) g4p_controls.GOption	fixedOption
(package private) g4p_controls.GLabel	gainLabel
(package private) g4p_controls.GSlider	gainSlider
(package private) GestureGranularConfig.Builder	gConfig
PAGranularInstrumentDirector	gDir
(package private) int	genHeight
(package private) int	genWidth
(package private) g4p_controls.GOption	gestureOption
int	gMaxVoices
(package private) GestureGranularParams	gParamsFixed
(package private) int	grainDuration
(package private) g4p_controls.GTextField	grainLengthField
(package private) g4p_controls.GLabel	grainLengthLabel
(package private) g4p_controls.GSlider	grainLengthSlider
(package private) ArrayList<TimedLocation>	grainTimeLocs
ADSRParams	granEnvelope
int	granHop
int	granLength
(package private) int	granSamples
float[]	granSignal
(package private) ArrayList<GranularBrush>	granularBrushes
(package private) ADSRParams	granularEnv
float	granularGain
float	granularPointGain
PAGranularInstrument	gSynth
(package private) boolean	guiSyncing
(package private) float	highPitchScaling
(package private) g4p_controls.GTextField	hopLengthField
(package private) g4p_controls.GLabel	hopLengthLabel
(package private) g4p_controls.GSlider	hopLengthSlider
(package private) g4p_controls.GToggleGroup	hopModeGroup
(package private) g4p_controls.GLabel	hopModeLabel
(package private) int	hopSamples
(package private) float	hopScale
private AudioBrush	hoverBrush	AudioBrush wraps a PACurveMaker (gesture) and a GestureGranularConfig.Builder (granular synthesis parameters)
(package private) int	hoverBrushColor1
(package private) int	hoverBrushColor2
private int	hoverIndex
(package private) File	imageFile
(package private) int	imageFileHeight
(package private) String	imageFileName
(package private) String	imageFilePath
(package private) String	imageFileTag
(package private) int	imageFileWidth
(package private) boolean	isAnimating
(package private) boolean	isBlending
(package private) boolean	isBufferStale
(package private) boolean	isDebugging
boolean	isDrawMode
(package private) boolean	isIgnoreOutsideBounds
(package private) boolean	isLoadToBoth
(package private) boolean	isMuted
(package private) boolean	isRecordingVideo
(package private) boolean	isRunWordGame
(package private) boolean	isTrackMouse
(package private) boolean	isVerbose
(package private) g4p_controls.GOption	linearWarpOption
(package private) int	lineColor
(package private) int	longSample
(package private) float	lowPitchScaling
(package private) processing.core.PImage	mapImage
(package private) PixelAudioMapper	mapper
(package private) int	mapSize
(package private) float	maxAmplitude
(package private) int	maxBurstGrains
(package private) ddf.minim.Minim	minim	Minim audio library
(package private) MultiGen	multigen
(package private) int	noteDuration
(package private) boolean	oldIsAnimating
(package private) int	optGrainCount
(package private) float	outputGain
(package private) g4p_controls.GToggleGroup	pathSourceGroup
(package private) g4p_controls.GLabel	pathSourceLabel
(package private) g4p_controls.GLabel	pitchLabel
(package private) float	pitchScaling
(package private) g4p_controls.GTextField	pitchShiftText
(package private) PixelAudio	pixelaudio
(package private) ddf.minim.MultiChannelBuffer	playBuffer
(package private) boolean	pointEventUseSampler
(package private) ArrayList<TimedLocation>	pointTimeLocs
int	polySteps
(package private) PASamplerInstrumentPool	pool
(package private) int	poolSize
(package private) g4p_controls.GSlider	rdpEpsilonSlider
(package private) g4p_controls.GOption	rdpOption
(package private) int	readyBrushColor1
(package private) int	readyBrushColor2
(package private) float	releaseTime
(package private) g4p_controls.GTextField	resampleField
(package private) g4p_controls.GLabel	resampleLabel
(package private) g4p_controls.GSlider	resampleSlider
(package private) int	samplelen
(package private) int	samplePos
(package private) float	sampleRate
(package private) ArrayList<SamplerBrush>	samplerBrushes
(package private) ADSRParams	samplerEnv
(package private) float	samplerGain
(package private) float	samplerPointGain
(package private) ArrayList<TimedLocation>	samplerTimeLocs
(package private) GestureScheduleBuilder	scheduleBuilder
(package private) int	selectedBrushColor1
(package private) int	selectedBrushColor2
(package private) int	shift
(package private) int	shortSample
(package private) int	sMaxVoices
(package private) g4p_controls.GOption	squareRootOption
int	startTime
(package private) int	step
(package private) float	sustainLevel
(package private) int	totalShift
(package private) boolean	useLongBursts
(package private) boolean	usePitchedGrains
(package private) boolean	useShortGrain
(package private) int	videoFrameRate
(package private) com.hamoid.VideoExport	videx
(package private) g4p_controls.GToggleGroup	warpGroup
(package private) g4p_controls.GLabel	warpLabel
(package private) g4p_controls.GSlider	warpSlider

Fields inherited from class processing.core.PApplet

args, ARGS_BGCOLOR, ARGS_DISABLE_AWT, ARGS_DISPLAY, ARGS_EDITOR_LOCATION, ARGS_EXTERNAL, ARGS_FULL_SCREEN, ARGS_HIDE_STOP, ARGS_LOCATION, ARGS_PRESENT, ARGS_SKETCH_FOLDER, ARGS_STOP_COLOR, ARGS_UI_SCALE, ARGS_WINDOW_COLOR, DEFAULT_HEIGHT, DEFAULT_WIDTH, disableAWT, displayHeight, displayWidth, dmouseX, dmouseY, emouseX, emouseY, exitCalled, EXTERNAL_MOVE, EXTERNAL_STOP, finished, firstMouse, focused, frameCount, frameRate, frameRateLastNanos, g, height, insideDraw, javaPlatform, javaVersion, javaVersionName, key, keyCode, keyEvent, keyPressed, keyRepeatEnabled, looping, matchPatterns, mouseButton, mouseEvent, mousePressed, mouseX, mouseY, pixelDensity, pixelHeight, pixels, pixelWidth, platform, pmouseX, pmouseY, ratioLeft, ratioScale, ratioTop, recorder, redraw, rheight, rmouseX, rmouseY, rwidth, surface, useNativeSelect, width, windowX, windowY

Fields inherited from interface processing.core.PConstants

ADD, ALPHA, ALT, AMBIENT, ARC, ARGB, ARROW, BACKSPACE, BASELINE, BEVEL, BEZIER_VERTEX, BLEND, BLUR, BOTTOM, BOX, BREAK, BURN, CENTER, CHATTER, CHORD, CLAMP, CLOSE, CODED, COMPLAINT, CONTROL, CORNER, CORNERS, CROSS, CURVE_VERTEX, CUSTOM, DARKEST, DEG_TO_RAD, DELETE, DIAMETER, DIFFERENCE, DILATE, DIRECTIONAL, DISABLE_ASYNC_SAVEFRAME, DISABLE_BUFFER_READING, DISABLE_DEPTH_MASK, DISABLE_DEPTH_SORT, DISABLE_DEPTH_TEST, DISABLE_KEY_REPEAT, DISABLE_NATIVE_FONTS, DISABLE_OPENGL_ERRORS, DISABLE_OPTIMIZED_STROKE, DISABLE_STROKE_PERSPECTIVE, DISABLE_STROKE_PURE, DISABLE_TEXTURE_MIPMAPS, DODGE, DOWN, DXF, ELLIPSE, ENABLE_ASYNC_SAVEFRAME, ENABLE_BUFFER_READING, ENABLE_DEPTH_MASK, ENABLE_DEPTH_SORT, ENABLE_DEPTH_TEST, ENABLE_KEY_REPEAT, ENABLE_NATIVE_FONTS, ENABLE_OPENGL_ERRORS, ENABLE_OPTIMIZED_STROKE, ENABLE_STROKE_PERSPECTIVE, ENABLE_STROKE_PURE, ENABLE_TEXTURE_MIPMAPS, ENTER, EPSILON, ERODE, ESC, EXCLUSION, FX2D, GIF, GRAY, GROUP, HALF_PI, HAND, HARD_LIGHT, HINT_COUNT, HSB, IMAGE, INVERT, JAVA2D, JPEG, LANDSCAPE, LEFT, LIGHTEST, LINE, LINE_LOOP, LINE_STRIP, LINES, LINUX, MACOS, MACOSX, MAX_FLOAT, MAX_INT, MIN_FLOAT, MIN_INT, MITER, MODEL, MODELVIEW, MOVE, MULTIPLY, NORMAL, OPAQUE, OPEN, OPENGL, ORTHOGRAPHIC, OTHER, OVERLAY, P2D, P3D, PATH, PDF, PERSPECTIVE, PI, PIE, platformNames, POINT, POINTS, POLYGON, PORTRAIT, POSTERIZE, PROBLEM, PROJECT, PROJECTION, QUAD, QUAD_BEZIER_VERTEX, QUAD_STRIP, QUADRATIC_VERTEX, QUADS, QUARTER_PI, RAD_TO_DEG, RADIUS, RECT, REPEAT, REPLACE, RETURN, RGB, RIGHT, ROUND, SCREEN, SHAPE, SHIFT, SOFT_LIGHT, SPAN, SPHERE, SPOT, SQUARE, SUBTRACT, SVG, TAB, TARGA, TAU, TEXT, THIRD_PI, THRESHOLD, TIFF, TOP, TRIANGLE, TRIANGLE_FAN, TRIANGLE_STRIP, TRIANGLES, TWO_PI, UP, VERTEX, WAIT, WHITESPACE, WINDOWS, X, Y, Z

Constructor Summary

Constructors

Constructor	Description
TutorialOne_05_GesturePlayground()

Method Summary

Modifier and Type	Method	Description
void	addControlsToPanel()	Add the controls to the control palette.
void	addDrawingPoint(int x, int y)	While user is dragging the mouse and mode == Mode.DRAW_EDIT_GRANULAR or DRAW_EDIT_SAMPLER, accumulates new points to allPoints and event times to allTimes.
void	adjustAudioGain(float g)	Adjusts audioOut.gain.
void	allOption_clicked(g4p_controls.GOption source, g4p_controls.GEvent event)
(package private) int	appendGranularBrush(GranularBrush gb)	Append a granular brush and return its new index.
(package private) int	appendSamplerBrush(SamplerBrush sb)	Append a sampler brush and return its new index.
int[]	applyColor(int[] colorSource, int[] graySource, int[] lut)	Utility method for applying hue and saturation values from a source array of RGB values to the brightness values in a target array of RGB values, using a lookup table to redirect indexing.
void	applyColorMap()	Applies the Hue and Saturation of pixel values in the colors[] array to mapImage and baseImage.
int[]	applyColorShifted(int[] colorSource, int[] graySource, int[] lut, int shift)	Utility method for applying hue and saturation values from a source array of RGB values to the brightness values in a target array of RGB values, using a lookup table to redirect indexing, taking into account any pixels that were shifted.
void	arcLengthTimeOption_clicked(g4p_controls.GOption source, g4p_controls.GEvent event)
void	audioFileSelectedWrite(File selection)
static void	blendInto(ddf.minim.MultiChannelBuffer dest, ddf.minim.MultiChannelBuffer src, float weight, boolean normalize, float targetDB)	Blends audio data from buffer "src" into buffer "dest" in place.
PAGranularInstrument	buildGranSynth(ddf.minim.AudioOutput out, ADSRParams env, int numVoices)	Initializes a PAGranularInstrument.
void	burstSlider_changed(g4p_controls.GSlider source, g4p_controls.GEvent event)
int	calcGranularOptHints(String tag, int N, float Tms, int hopSamples, int grainLenSamples, float sr, List<processing.core.PVector> scheduledPoints, float targetSpacingPx, float wt, float ws, StringBuffer sb)	Calculate optimal configuration settings for a granular brush.
int	calcSampleLen()
int	calcSampleLen(int dur, float mean, float variance)
ADSRParams	calculateEnvelopeDb(float gainDb, int totalSamples, float sampleRate)	Calculate an envelope of length totalSamples.
ADSRParams	calculateEnvelopeLinear(float linear, float totalMs)	Calculate an envelope of length totalSamples.
void	chooseFile()	Wrapper method for Processing's selectInput command
(package private) static int	clampInt(int v, int lo, int hi)
int	clipToHeight(int y)
int	clipToWidth(int x)
void	commitMapImageToAudio()
void	commitMapImageToBaseImage()	Writes the mapImage, which may change with animation, to the baseImage, a reference image that usually only changes when a new file is loaded.
void	commitNewBaseImage(processing.core.PImage img)	Copies the supplied PImage to mapImage and baseImage, sets totalShift to 0 (the images are identical).
void	controlPanel_hit(g4p_controls.GPanel source, g4p_controls.GEvent event)
void	createCommentsField()
void	createControlPanel()	Create the GUI control palette.
void	createControls()	Create all the controls in the control palette.
void	createControlWindow()	Create a separate window for the GUI control palette.
void	createGUI()	Create all the GUI controls.
void	curveOption_clicked(g4p_controls.GOption source, g4p_controls.GEvent event)
void	curvePointsSlider_changed(g4p_controls.GSlider source, g4p_controls.GEvent event)
void	customWarpOption_clicked(g4p_controls.GOption source, g4p_controls.GEvent event)
(package private) static void	debugIndexHeadroom(float[] buf, int[] startIndices, GestureGranularParams ggp)
(package private) static void	debugTimesMs(GestureSchedule s)
void	draw()
void	drawBrushes(List<? extends AudioBrush> brushes, int readyColor, int hoverColor, int selectedColor)	Iterates over a brush list and draws the brushstrokes stored in each PACurveMaker in the list.
void	drawBrushShapes()	Iterates over brushShapesList and draws the brushstrokes stored in each PACurveMaker in the list.
void	drawCircle(int x, int y)	Draws a circle at the location of an audio trigger (mouseDown event).
void	durationSlider_changed(g4p_controls.GSlider source, g4p_controls.GEvent event)
(package private) void	ensureGranularReady()	Prepares Granular instruments and assets
(package private) void	ensureSamplerReady()	Prepares Sampler instruments and assets
void	envelopeMenu_clicked(g4p_controls.GDropList source, g4p_controls.GEvent event)
(package private) static boolean	envEquals(ADSRParams a, ADSRParams b)
(package private) int	envMenuIndex(String name)
(package private) String	envNameFor(ADSRParams env)
(package private) static ADSRParams	envPreset(String name)
void	expWarpOption_clicked(g4p_controls.GOption source, g4p_controls.GEvent event)
void	fileSelected(File selectedFile)	callback method for chooseFile(), handles standard audio and image formats for Processing.
(package private) TutorialOne_05_GesturePlayground.BrushHit	findHoverHit()
void	fixedOption_clicked(g4p_controls.GOption source, g4p_controls.GEvent event)
(package private) static String	fmt(float v, int decimals)
(package private) String	formatEnv(ADSRParams env)
void	gainSlider_changed(g4p_controls.GSlider source, g4p_controls.GEvent event)
(package private) float[]	generateJitterPitch(int length, float deviationPitch)
void	gestureOption_clicked(g4p_controls.GOption source, g4p_controls.GEvent event)
int[]	getColors(int size)	Generates an array of rainbow colors using the HSB color space.
processing.core.PVector	getCoordFromSignalPos(int pos)	Calculates the display image coordinates corresponding to a specified audio sample index.
(package private) ArrayList<processing.core.PVector>	getPathPoints(AudioBrush b)	Provides the list of points for a brush in its assigned PathMode representation.
int	getSamplePos(int x, int y)	Calculates the index of the image pixel within the signal path, taking the shifting of pixels and audioSignal into account.
GestureSchedule	getScheduleForBrush(AudioBrush b)
void	grainLengthField_changed(g4p_controls.GTextField source, g4p_controls.GEvent event)
void	grainLengthSlider_changed(g4p_controls.GSlider source, g4p_controls.GEvent event)
void	handleClickOutsideBrush(int x, int y)	Respond to mousePressed events, usually by triggering an event
void	handleDrawing()	Handles user's drawing actions, draws previously recorded brushstrokes, tracks and generates animation and audio events.
void	hopLengthField_changed(g4p_controls.GTextField source, g4p_controls.GEvent event)
void	hopLengthSlider_changed(g4p_controls.GSlider source, g4p_controls.GEvent event)
void	imageFileSelectedWrite(File selection)
void	initAllPoints()	Initializes allPoints and adds the current mouse location to it.
void	initAudio()	CALL THIS METHOD IN SETUP() Initializes Minim audio library and audio variables.
void	initConfig()	Initializes default settings for granular synthesis, defaultGranConfig, and for sampler synthesis, defaultSampConfig.
AudioBrush	initCurveMakerAndAddBrush()	Initializes a PACurveMaker instance with allPoints as an argument to the factory method PACurveMaker.buildCurveMaker() and then fills in PACurveMaker instance variables.
void	initDrawing()	Initializes drawing and drawing interaction variables.
void	initGranularParams()	Initializes gParamsFixed, a GestureGranularParams instances used for granular point events.
void	initGUI()	Initializes the control palette and its draw loop.
void	initImages()	Initializes mapImage with the colors array, copies it to baseImage.
void	initListener()	Sets up sample-accurate AudioListener called from the Minim audio processing loop.
void	initTimedEventLists()	Initialize lists of TimedLocation objects, used for animated response to mouse clicks on brushstrokes and outside brushstrokes.
(package private) boolean	isBrushInteractable(AudioBrush b)
(package private) boolean	isEditable()
(package private) boolean	isGuiTyping()
(package private) boolean	isOverAnyBrush(int x, int y)
processing.core.PVector	jitterCoord(int x, int y, int deviationPx)	Displaces a supplied point by a random Gaussian variable.
void	keyPressed()	built-in keyPressed handler, forwards events to parseKey.
void	linearWarpOption_clicked(g4p_controls.GOption source, g4p_controls.GEvent event)
void	loadAudioFile(File audFile)	Attempts to load audio data from a selected file into playBuffer, then calls writeAudioToImage() to transcode audio data and write it to mapImage.
GestureSchedule	loadGestureSchedule(PACurveMaker brush, GestureGranularConfig snap)	Builds a GestureSchedule for a PACurveMaker brush and a snapshot of a GestureGranularConfig
void	loadImageFile(File imgFile)	Attempts to load image data from a selected file into mapImage, then calls writeImageToAudio() to transcode HSB brightness channel to audio and writes it to playBuffer and audioSignal.
MultiGen	loadWordGen(int wordGenW, int wordGenH)	Adds PixelMapGen objects to the local variable genList.
static void	main(String[] args)
void	mouseClicked()
void	mouseDragged()
boolean	mouseInPoly(ArrayList<processing.core.PVector> poly)
void	mousePressed()	The built-in mousePressed handler for Processing, used to begin drawing.
void	mouseReleased()
(package private) static boolean	nearlyEqual(float a, float b)
static void	normalize(float[] signal, float targetPeakDB)	Normalizes a single-channel signal array to a target RMS level in dBFS (decibels relative to full scale).
(package private) void	normalizeConfigForGranular(GestureGranularConfig.Builder cfg)	Normalize config values when converting to GranularBrush.
(package private) void	normalizeConfigForSampler(GestureGranularConfig.Builder cfg)	Normalize config values when converting to SamplerBrush.
void	parseKey(char key, int keyCode)	Handles key press events passed on by the built-in keyPressed method.
void	pitchShiftText_changed(g4p_controls.GTextField source, g4p_controls.GEvent event)
void	playGranularGesture(float[] buf, GestureSchedule sched, GestureGranularParams params)	Primary method for playing a granular synthesis audio event.
int	playSample(int samplePos, int samplelen, float amplitude, float pan)	Plays an audio sample with default envelope and stereo pan.
int	playSample(int samplePos, int samplelen, float amplitude, ADSRParams env, float pan)	Plays an audio sample with a custom envelope and stereo pan.
int	playSample(int samplePos, int samplelen, float amplitude, ADSRParams env, float pitch, float pan)	Plays an audio sample with with a custom envelope, pitch and stereo pan.
boolean	pointInPoly(ArrayList<processing.core.PVector> poly, int x, int y)
void	preloadFiles(String path, String fileName)	Preload an audio file using a file path and a filename.
void	printGConfigStatus()
(package private) void	printGOptHints(float alpha)	Print suggested values for optimizing grain overlap for a brush.
static int	quantizeToStep(int value, int step)	Quantize an integer to the nearest multiple of step.
void	rdpEpsilonSlider_changed(g4p_controls.GSlider source, g4p_controls.GEvent event)
void	rdpOption_clicked(g4p_controls.GOption source, g4p_controls.GEvent event)
(package private) void	recomputeUIBaselinesFromActiveBrush()	Caching for UI settings, may be superfluous.
void	refreshMapImageFromBase()	Writes baseImage to mapImage with an index position offset of totalShift.
void	removeActiveBrush()	Removes the current active PACurveMaker instance, flagged by a highlighted brush stroke, from brushShapesList, if there is one.
(package private) void	removeGranularBrush(AudioBrush gb, int idx)	Remove a granular brush using index when reliable, else by object.
void	removeHoverBrush()	Removes the current active PACurveMaker instance, flagged by a highlighted brush stroke, from brushShapesList, if there is one.
void	removeNewestBrush()	Removes the newest PACurveMaker instance, shown as a brush stroke in the display, from brushShapesList.
void	removeOldestBrush()	Removes the oldest brush in brushShapesList.
(package private) void	removeSamplerBrush(AudioBrush sb, int idx)	Remove a sampler brush using index when reliable, else by object.
void	renderAudioToMapImage(PixelAudioMapper.ChannelNames chan, int shift)	Transcodes audio data in audioSignal and writes it to color channel chan of mapImage.
void	renderMapImageToAudio(PixelAudioMapper.ChannelNames chan)	Writes a specified channel of mapImage to audioSignal.
(package private) void	replaceBrush(AudioBrush oldBrush, AudioBrush newBrush, int oldIndex)	Remove oldBrush from its current typed list, insert newBrush into the opposite typed list, and preserve hover/active state.
void	resampleSlider_changed(g4p_controls.GSlider source, g4p_controls.GEvent event)
void	reset(boolean isClearCurves)	Reinitializes audio and clears event lists.
(package private) void	resetConfigForMode()	Reset tool config to defaults (copy, so default config never mutates).
(package private) void	resetToDefaults()
void	runGrainEvents()	Tracks and runs TimedLocation events in the grainLocsArray list, which is associated with granular synthesis gestures.
(package private) void	runGranularPointEvent(int x, int y)	Plays a granular burst and animates a point
void	runPointEvents()	Tracks and runs TimedLocation events in the timeLocsArray list, which is associated with mouse clicks that trigger audio a the click point.
void	runSamplerBrushEvents()
(package private) void	runSamplerPointEvent(int x, int y)	Plays a sample and animates a point
void	saveAudioToFile(float[] samples, float sampleRate, String fileName)	Saves audio data to 16-bit integer PCM format, which Processing can also open.
void	saveImageToFile(processing.core.PImage img, String fileName)
void	saveToAudio()	Calls Processing's selectOutput method to start the process of saving the current audio signal to a .wav file.
void	saveToImage()	Calls Processing's selectOutput method to start the process of saving the mapImage (the offscreen copy of the display image) to a .png file.
(package private) void	scheduleGranularBrushClick(GranularBrush gb, int clickX, int clickY)
(package private) void	scheduleSamplerBrushClick(SamplerBrush sb, int clickX, int clickY)
(package private) void	setActiveBrush(AudioBrush brush)	Assigns a brush to be the current active brush, accessible for editing and other options.
(package private) void	setActiveBrush(AudioBrush brush, int idx)
static int	setAlpha(int argb, int alpha)	Sets the alpha channel of an RGBA color.
int	setAlphaWithBlack(int argb, int alpha)	Sets the alpha channel of an RGBA color, conditionally setting alpha = 0 if all other channels = 0.
(package private) void	setControlsEnabled()	Determine which controls to enable, based on the drawing mode.
(package private) void	setMode(TutorialOne_05_GesturePlayground.DrawingMode newMode)	Sets the drawing mode.
void	settings()
void	setup()
void	showHelp()	to generate help output, run RegEx search/replace on parseKey case lines with: // case ('.'): // (.+) // println(" * Press $1 to $2.");
void	squareRootOption_clicked(g4p_controls.GOption source, g4p_controls.GEvent event)
void	stop()	turn off audio processing when we exit
void	storeGranularCurveTL(GestureSchedule sched, int startTime, boolean isGesture)
void	storeSamplerCurveTL(GestureSchedule sched, int startTime)
(package private) void	syncDrawingModeToBrush(AudioBrush brush)	Change the current DrawingMode to suit the brush passed as an argument.
(package private) void	syncGuiFromConfig()	Synchronize the control palette knobs to the current gConfig, probably because a brush was selected and made active.
(package private) AudioBrush	toggleActiveBrushType()	Toggle the currently active brush between SamplerBrush and GranularBrush.
(package private) AudioBrush	toggleBrushType(AudioBrush brush)	Convert a brush to the opposite type, reusing the same PACurveMaker and the same GestureGranularConfig.Builder instance.
(package private) AudioBrush	toggleHoveredBrushType()	Toggle the currently hovered brush between SamplerBrush and GranularBrush.
(package private) GranularBrush	toGranularBrush(AudioBrush brush)	Convert a brush explicitly to GranularBrush.
(package private) SamplerBrush	toSamplerBrush(AudioBrush brush)	Convert a brush explicitly to SamplerBrush.
(package private) void	updateAudioChain(float[] sig)
(package private) void	updateAudioChain(float[] sig, float bufferSampleRate)	Bottleneck "commit" method for audio state.
(package private) void	updateHover()	Update the hoverBrush and hoverIndex global variables.
void	warpSlider_changed(g4p_controls.GSlider source, g4p_controls.GEvent event)
void	winDraw(processing.core.PApplet appc, g4p_controls.GWinData data)
void	winKey(processing.core.PApplet appc, g4p_controls.GWinData data, processing.event.KeyEvent evt)
void	writeAudioToImage(float[] sig, PixelAudioMapper mapper, processing.core.PImage img, PixelAudioMapper.ChannelNames chan)	Transcodes audio data in sig[] and writes it to color channel chan of mapImage using the lookup tables in mapper to redirect indexing.
void	writeAudioToImage(float[] sig, PixelAudioMapper mapper, processing.core.PImage img, PixelAudioMapper.ChannelNames chan, int shift)	Transcodes audio data in sig[] and writes it to color channel chan of img using the lookup tables in mapper to redirect indexing.
void	writeImageToAudio(processing.core.PImage img, PixelAudioMapper mapper, float[] sig, PixelAudioMapper.ChannelNames chan, int shift)	This method writes a color channel from an image to playBuffer, fulfilling a central concept of the PixelAudio library: image is sound.
void	writeToScreen(String msg, int x, int y, int weight, boolean isWhite)	Displays a line of text to the screen, usually in the draw loop.

Methods inherited from class processing.core.PApplet

abs, abs, acos, alpha, ambient, ambient, ambient, ambientLight, ambientLight, append, append, append, append, append, append, applyMatrix, applyMatrix, applyMatrix, applyMatrix, applyMatrix, arc, arc, arraycopy, arraycopy, arraycopy, arrayCopy, arrayCopy, arrayCopy, asin, atan, atan2, attrib, attrib, attrib, attribColor, attribNormal, attribPosition, background, background, background, background, background, background, background, beginCamera, beginContour, beginPGL, beginRaw, beginRaw, beginRecord, beginRecord, beginShape, beginShape, bezier, bezier, bezierDetail, bezierPoint, bezierTangent, bezierVertex, bezierVertex, binary, binary, binary, binary, blend, blend, blendColor, blendMode, blue, box, box, brightness, calcSketchPath, camera, camera, ceil, checkAlpha, checkExtension, choice, choice, circle, clear, clip, color, color, color, color, color, color, color, color, colorMode, colorMode, colorMode, colorMode, concat, concat, concat, concat, concat, concat, concat, constrain, constrain, copy, copy, copy, cos, createFont, createFont, createFont, createGraphics, createGraphics, createGraphics, createImage, createInput, createInput, createInputRaw, createOutput, createOutput, createPath, createPath, createPrimaryGraphics, createReader, createReader, createReader, createShape, createShape, createShape, createWriter, createWriter, createWriter, cursor, cursor, cursor, cursor, curve, curve, curveDetail, curvePoint, curveTangent, curveTightness, curveVertex, curveVertex, dataFile, dataPath, day, debug, degrees, delay, dequeueEvents, desktopFile, desktopPath, die, die, directionalLight, displayDensity, displayDensity, dispose, dist, dist, edge, ellipse, ellipseMode, emissive, emissive, emissive, endCamera, endContour, endPGL, endRaw, endRecord, endShape, endShape, exec, exec, exit, exitActual, exitCalled, exp, expand, expand, expand, expand, expand, expand, expand, expand, expand, expand, expand, expand, expand, expand, expand, expand, expand, expand, fill, fill, fill, fill, fill, fill, filter, filter, filter, floor, flush, focusGained, focusLost, frameMoved, frameRate, frustum, fullScreen, fullScreen, fullScreen, fullScreen, get, get, get, getExtension, getGraphics, getMatrix, getMatrix, getMatrix, getSurface, green, handleDraw, handleKeyEvent, handleMethods, handleMouseEvent, hex, hex, hex, hex, hideMenuBar, hint, hour, hue, image, image, image, imageMode, initSurface, insertFrame, isLooping, join, join, keyPressed, keyReleased, keyReleased, keyTyped, keyTyped, launch, lerp, lerpColor, lerpColor, lightFalloff, lights, lightSpecular, line, line, link, listFiles, listFiles, listPaths, loadBytes, loadBytes, loadBytes, loadFont, loadImage, loadImage, loadJSONArray, loadJSONArray, loadJSONObject, loadJSONObject, loadPixels, loadShader, loadShader, loadShape, loadShape, loadStrings, loadStrings, loadStrings, loadStrings, loadTable, loadTable, loadXML, loadXML, log, loop, mag, mag, main, main, main, makeGraphics, map, mask, match, matchAll, max, max, max, max, max, max, method, millis, min, min, min, min, min, min, minute, modelX, modelY, modelZ, month, mouseClicked, mouseDragged, mouseEntered, mouseEntered, mouseExited, mouseExited, mouseMoved, mouseMoved, mousePressed, mouseReleased, mouseWheel, mouseWheel, nf, nf, nf, nf, nf, nf, nfc, nfc, nfc, nfc, nfp, nfp, nfp, nfp, nfs, nfs, nfs, nfs, noClip, noCursor, noFill, noise, noise, noise, noiseDetail, noiseDetail, noiseSeed, noLights, noLoop, norm, normal, noSmooth, noStroke, noTexture, noTint, orientation, ortho, ortho, ortho, parseBoolean, parseBoolean, parseBoolean, parseBoolean, parseByte, parseByte, parseByte, parseByte, parseByte, parseByte, parseByte, parseByte, parseChar, parseChar, parseChar, parseChar, parseFloat, parseFloat, parseFloat, parseFloat, parseFloat, parseFloat, parseFloat, parseInt, parseInt, parseInt, parseInt, parseInt, parseInt, parseInt, parseInt, parseInt, parseInt, parseInt, parseInt, parseJSONArray, parseJSONObject, parseXML, parseXML, pause, perspective, perspective, pixelDensity, point, point, pointLight, pop, popMatrix, popStyle, postEvent, postWindowMoved, postWindowResized, pow, print, print, print, print, print, print, print, print, print, printArray, printCamera, println, println, println, println, println, println, println, println, println, println, println, printMatrix, printProjection, printStackTrace, push, pushMatrix, pushStyle, quad, quadraticVertex, quadraticVertex, radians, random, random, randomGaussian, randomSeed, rect, rect, rect, rectMode, red, redraw, registerMethod, requestImage, requestImage, resetMatrix, resetShader, resetShader, resume, reverse, reverse, reverse, reverse, reverse, reverse, reverse, rotate, rotate, rotateX, rotateY, rotateZ, round, runSketch, runSketch, runSketch, saturation, save, saveBytes, saveBytes, saveBytes, saveFile, saveFrame, saveFrame, saveJSONArray, saveJSONArray, saveJSONObject, saveJSONObject, savePath, saveStream, saveStream, saveStream, saveStream, saveStream, saveStrings, saveStrings, saveStrings, saveTable, saveTable, saveXML, saveXML, scale, scale, scale, screenX, screenX, screenY, screenY, screenZ, second, selectCallback, selectFolder, selectFolder, selectFolder, selectInput, selectInput, selectInput, selectOutput, selectOutput, selectOutput, set, set, setMatrix, setMatrix, setMatrix, setSize, shader, shader, shape, shape, shape, shapeMode, shearX, shearY, shell, shininess, shorten, shorten, shorten, shorten, shorten, shorten, shorten, showDepthWarning, showDepthWarningXYZ, showMethodWarning, showMissingWarning, showSurface, showVariationWarning, sin, size, size, size, sketchDisplay, sketchFile, sketchFullScreen, sketchHeight, sketchOutputPath, sketchOutputStream, sketchPath, sketchPath, sketchPixelDensity, sketchRenderer, sketchSmooth, sketchWidth, sketchWindowColor, smooth, smooth, sort, sort, sort, sort, sort, sort, sort, sort, sort, sort, specular, specular, specular, sphere, sphereDetail, sphereDetail, splice, splice, splice, splice, splice, splice, splice, splice, splice, splice, splice, splice, splice, split, split, splitTokens, splitTokens, spotLight, sq, sqrt, square, start, startSurface, str, str, str, str, str, str, str, str, str, str, stroke, stroke, stroke, stroke, stroke, stroke, strokeCap, strokeJoin, strokeWeight, style, subset, subset, subset, subset, subset, subset, subset, subset, subset, subset, subset, subset, subset, subset, subset, subset, subset, subset, tan, text, text, text, text, text, text, text, text, text, text, text, textAlign, textAlign, textAscent, textDescent, textFont, textFont, textLeading, textMode, textSize, texture, textureMode, textureWrap, textWidth, textWidth, textWidth, thread, tint, tint, tint, tint, tint, tint, translate, translate, triangle, trim, trim, unbinary, unhex, unregisterMethod, updatePixels, updatePixels, urlDecode, urlEncode, vertex, vertex, vertex, vertex, vertex, windowMove, windowMoved, windowRatio, windowResizable, windowResize, windowResized, windowTitle, year

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

pixelaudio

PixelAudio pixelaudio

multigen

MultiGen multigen

genWidth

int genWidth

genHeight

int genHeight

mapper

PixelAudioMapper mapper

mapSize

int mapSize

baseImage

processing.core.PImage baseImage

mapImage

processing.core.PImage mapImage

chan

PixelAudioMapper.ChannelNames chan

colors

int[] colors

audioFile

File audioFile

audioFilePath

String audioFilePath

audioFileName

String audioFileName

audioFileTag

String audioFileTag

audioFileLength

int audioFileLength

imageFile

File imageFile

imageFilePath

String imageFilePath

imageFileName

String imageFileName

imageFileTag

String imageFileTag

imageFileWidth

int imageFileWidth

imageFileHeight

int imageFileHeight

isLoadToBoth

boolean isLoadToBoth

isBlending

boolean isBlending

minim

ddf.minim.Minim minim

Minim audio library

audioOut

ddf.minim.AudioOutput audioOut

isBufferStale

boolean isBufferStale

sampleRate

float sampleRate

fileSampleRate

float fileSampleRate

bufferSampleRate

float bufferSampleRate

doResample

boolean doResample

audioSignal

float[] audioSignal

playBuffer

ddf.minim.MultiChannelBuffer playBuffer

samplePos

int samplePos

audioLength

int audioLength

samplerEnv

ADSRParams samplerEnv

granularEnv

ADSRParams granularEnv

maxAmplitude

float maxAmplitude

attackTime

float attackTime

decayTime

float decayTime

sustainLevel

float sustainLevel

releaseTime

float releaseTime

pitchScaling

float pitchScaling

defaultPitchScaling

float defaultPitchScaling

lowPitchScaling

float lowPitchScaling

highPitchScaling

float highPitchScaling

envIsGranular

boolean envIsGranular

grainDuration

int grainDuration

noteDuration

int noteDuration

samplelen

int samplelen

samplerGain

float samplerGain

samplerPointGain

float samplerPointGain

outputGain

float outputGain

isMuted

boolean isMuted

pool

PASamplerInstrumentPool pool

poolSize

int poolSize

sMaxVoices

int sMaxVoices

granSignal

public float[] granSignal

gSynth

public PAGranularInstrument gSynth

curveSteps

public int curveSteps

granLength

public int granLength

granHop

public int granHop

gMaxVoices

public int gMaxVoices

granEnvelope

public ADSRParams granEnvelope

currentGranStatus

String currentGranStatus

gDir

public PAGranularInstrumentDirector gDir

granularGain

public float granularGain

granularPointGain

public float granularPointGain

useShortGrain

boolean useShortGrain

longSample

int longSample

shortSample

int shortSample

granSamples

int granSamples

hopSamples

int hopSamples

gParamsFixed

GestureGranularParams gParamsFixed

useLongBursts

boolean useLongBursts

maxBurstGrains

int maxBurstGrains

burstGrains

int burstGrains

usePitchedGrains

boolean usePitchedGrains

shift

int shift

totalShift

int totalShift

isAnimating

boolean isAnimating

oldIsAnimating

boolean oldIsAnimating

isTrackMouse

boolean isTrackMouse

animSteps

int animSteps

isRecordingVideo

boolean isRecordingVideo

videoFrameRate

int videoFrameRate

step

int step

videx

com.hamoid.VideoExport videx

curveMaker

public PACurveMaker curveMaker

isDrawMode

public boolean isDrawMode

epsilon

public float epsilon

currentPoint

public processing.core.PVector currentPoint

allPoints

public ArrayList<processing.core.PVector> allPoints

allTimes

public ArrayList<Integer> allTimes

startTime

public int startTime

dragColor

public int dragColor

dragWeight

public float dragWeight

polySteps

public int polySteps

readyBrushColor1

int readyBrushColor1

hoverBrushColor1

int hoverBrushColor1

selectedBrushColor1

int selectedBrushColor1

readyBrushColor2

int readyBrushColor2

hoverBrushColor2

int hoverBrushColor2

selectedBrushColor2

int selectedBrushColor2

dimmedBrushColor

int dimmedBrushColor

circleColor

int circleColor

dimCircleColor

int dimCircleColor

lineColor

int lineColor

dimLineColor

int dimLineColor

animatedCircleColor

int animatedCircleColor

isIgnoreOutsideBounds

boolean isIgnoreOutsideBounds

hoverBrush

private AudioBrush hoverBrush

AudioBrush wraps a PACurveMaker (gesture) and a GestureGranularConfig.Builder (granular synthesis parameters)

hoverIndex

private int hoverIndex

activeBrush

private AudioBrush activeBrush

granularBrushes

ArrayList<GranularBrush> granularBrushes

activeGranularBrush

GranularBrush activeGranularBrush

activeGranularIndex

int activeGranularIndex

samplerBrushes

ArrayList<SamplerBrush> samplerBrushes

activeSamplerBrush

SamplerBrush activeSamplerBrush

activeSamplerIndex

int activeSamplerIndex

pointTimeLocs

ArrayList<TimedLocation> pointTimeLocs

samplerTimeLocs

ArrayList<TimedLocation> samplerTimeLocs

grainTimeLocs

ArrayList<TimedLocation> grainTimeLocs

pointEventUseSampler

boolean pointEventUseSampler

gConfig

GestureGranularConfig.Builder gConfig

defaultGranConfig

final GestureGranularConfig.Builder defaultGranConfig

defaultSampConfig

final GestureGranularConfig.Builder defaultSampConfig

guiSyncing

boolean guiSyncing

baselineCount

int baselineCount

baselineDurationMs

int baselineDurationMs

scheduleBuilder

GestureScheduleBuilder scheduleBuilder

drawingMode

TutorialOne_05_GesturePlayground.DrawingMode drawingMode

CURVE_STEPS_HARD_MAX

static final int CURVE_STEPS_HARD_MAX

See Also:

• Constant Field Values

CURVE_STEPS_SAFE_MAX

static final int CURVE_STEPS_SAFE_MAX

See Also:

• Constant Field Values

CURVE_STEPS_FLOOR

static final int CURVE_STEPS_FLOOR

See Also:

• Constant Field Values

audioSched

AudioScheduler<TutorialOne_05_GesturePlayground.Happening> audioSched

audioBlockStartSample

private final AtomicLong audioBlockStartSample

audioNextBlockStartSample

private final AtomicLong audioNextBlockStartSample

hopScale

float hopScale

optGrainCount

int optGrainCount

eventStep

int eventStep

isVerbose

boolean isVerbose

isDebugging

boolean isDebugging

isRunWordGame

boolean isRunWordGame

doPlayOnDraw

boolean doPlayOnDraw

daPath

String daPath

daFile

String daFile

controlWindow

g4p_controls.GWindow controlWindow

controlPanel

g4p_controls.GPanel controlPanel

pathSourceLabel

g4p_controls.GLabel pathSourceLabel

pathSourceGroup

g4p_controls.GToggleGroup pathSourceGroup

allOption

g4p_controls.GOption allOption

rdpOption

g4p_controls.GOption rdpOption

curveOption

g4p_controls.GOption curveOption

rdpEpsilonSlider

g4p_controls.GSlider rdpEpsilonSlider

curvePointsSlider

g4p_controls.GSlider curvePointsSlider

pitchLabel

g4p_controls.GLabel pitchLabel

pitchShiftText

g4p_controls.GTextField pitchShiftText

resampleLabel

g4p_controls.GLabel resampleLabel

resampleSlider

g4p_controls.GSlider resampleSlider

resampleField

g4p_controls.GTextField resampleField

durationLabel

g4p_controls.GLabel durationLabel

durationSlider

g4p_controls.GSlider durationSlider

durationField

g4p_controls.GTextField durationField

burstLabel

g4p_controls.GLabel burstLabel

burstSlider

g4p_controls.GSlider burstSlider

hopModeLabel

g4p_controls.GLabel hopModeLabel

hopModeGroup

g4p_controls.GToggleGroup hopModeGroup

gestureOption

g4p_controls.GOption gestureOption

grainLengthLabel

g4p_controls.GLabel grainLengthLabel

grainLengthSlider

g4p_controls.GSlider grainLengthSlider

hopLengthLabel

g4p_controls.GLabel hopLengthLabel

hopLengthSlider

g4p_controls.GSlider hopLengthSlider

fixedOption

g4p_controls.GOption fixedOption

warpLabel

g4p_controls.GLabel warpLabel

warpSlider

g4p_controls.GSlider warpSlider

epsilonSliderLabel

g4p_controls.GLabel epsilonSliderLabel

curvePointsLabel

g4p_controls.GLabel curvePointsLabel

gainLabel

g4p_controls.GLabel gainLabel

gainSlider

g4p_controls.GSlider gainSlider

grainLengthField

g4p_controls.GTextField grainLengthField

hopLengthField

g4p_controls.GTextField hopLengthField

warpGroup

g4p_controls.GToggleGroup warpGroup

linearWarpOption

g4p_controls.GOption linearWarpOption

expWarpOption

g4p_controls.GOption expWarpOption

squareRootOption

g4p_controls.GOption squareRootOption

customWarpOption

g4p_controls.GOption customWarpOption

arcLengthTimeOption

g4p_controls.GOption arcLengthTimeOption

envelopeLabel

g4p_controls.GLabel envelopeLabel

envelopeMenu

g4p_controls.GDropList envelopeMenu

envelopeValuesLabel

g4p_controls.GLabel envelopeValuesLabel

commentsField

g4p_controls.GTextArea commentsField

ENV_CUSTOM

static final String ENV_CUSTOM

See Also:

• Constant Field Values

envPresetItems

String[] envPresetItems

Constructor Details

TutorialOne_05_GesturePlayground

public TutorialOne_05_GesturePlayground()

Method Details

main

public static void main(String[] args)

Parameters:

args -

settings

public void settings()

Overrides:

settings in class processing.core.PApplet

setup

public void setup()

Overrides:

setup in class processing.core.PApplet

stop

public void stop()

turn off audio processing when we exit

Overrides:

stop in class processing.core.PApplet

loadWordGen

public MultiGen loadWordGen(int wordGenW,
 int wordGenH)

Adds PixelMapGen objects to the local variable genList. The genList initializes a MultiGen, which can be used to map audio and pixel data. Generation order in offsetList follows the words in the workFlowPanel.png graphic.

Parameters:

wordGenW - width of single gen element

wordGenH - height of single gen element

Returns:

a MultiGen following the workFlowPanel.png layout

getColors

public int[] getColors(int size)

Generates an array of rainbow colors using the HSB color space.

Parameters:

size - the number of entries in the colors array

Returns:

an array of RGB colors ordered by hue

initImages

public void initImages()

Initializes mapImage with the colors array, copies it to baseImage. MapImage handles the color data for mapper and also serves as our display image. BaseImage is a reference image that typically changes only when you load a new image.

initDrawing

public void initDrawing()

Initializes drawing and drawing interaction variables.

initConfig

public void initConfig()

Initializes default settings for granular synthesis, defaultGranConfig, and for sampler synthesis, defaultSampConfig.

initGUI

public void initGUI()

Initializes the control palette and its draw loop.

preloadFiles

public void preloadFiles(String path,
 String fileName)

Preload an audio file using a file path and a filename.

Parameters:

path - the fully qualified path to the file's directory, ending with a '/'

fileName - the name of the file

draw

public void draw()

Overrides:

draw in class processing.core.PApplet

handleDrawing

public void handleDrawing()

Handles user's drawing actions, draws previously recorded brushstrokes, tracks and generates animation and audio events.

findHoverHit

TutorialOne_05_GesturePlayground.BrushHit findHoverHit()

Returns:

a reference to the brushstroke the mouse is over, or null if there's no brushstroke.

updateHover

void updateHover()

Update the hoverBrush and hoverIndex global variables.

writeToScreen

public void writeToScreen(String msg,
 int x,
 int y,
 int weight,
 boolean isWhite)

Displays a line of text to the screen, usually in the draw loop. Handy for debugging. typical call: writeToScreen("When does the mind stop and the world begin?", 64, 1000, 24, true);

Parameters:

msg - message to write

x - x coordinate

y - y coordinate

weight - font weight

isWhite - if true, white text, otherwise, black text

mousePressed

public void mousePressed()

The built-in mousePressed handler for Processing, used to begin drawing.

Overrides:

mousePressed in class processing.core.PApplet

mouseDragged

public void mouseDragged()

Overrides:

mouseDragged in class processing.core.PApplet

mouseReleased

public void mouseReleased()

Overrides:

mouseReleased in class processing.core.PApplet

mouseClicked

public void mouseClicked()

Overrides:

mouseClicked in class processing.core.PApplet

keyPressed

public void keyPressed()

built-in keyPressed handler, forwards events to parseKey.

Overrides:

keyPressed in class processing.core.PApplet

parseKey

public void parseKey(char key,
 int keyCode)

Handles key press events passed on by the built-in keyPressed method. By moving key event handling outside the built-in keyPressed method, we make it possible to post key commands without an actual key event. Methods and interfaces and even other threads can call parseKey(). This opens up many possibilities and a some risks, too.

Parameters:

key -

keyCode -

showHelp

public void showHelp()

to generate help output, run RegEx search/replace on parseKey case lines with: // case ('.'): // (.+) // println(" * Press $1 to $2.");

adjustAudioGain

public void adjustAudioGain(float g)

Adjusts audioOut.gain.

Parameters:

g - value to add to audioOut.gain, in decibels

setMode

void setMode(TutorialOne_05_GesturePlayground.DrawingMode newMode)

Sets the drawing mode.

Parameters:

newMode -

resetConfigForMode

void resetConfigForMode()

Reset tool config to defaults (copy, so default config never mutates).

chooseFile

public void chooseFile()

Wrapper method for Processing's selectInput command

fileSelected

public void fileSelected(File selectedFile)

callback method for chooseFile(), handles standard audio and image formats for Processing. If a file has been successfully selected, continues with a call to loadAudioFile() or loadImageFile().

Parameters:

selectedFile - the File the user selected

loadAudioFile

public void loadAudioFile(File audFile)

Attempts to load audio data from a selected file into playBuffer, then calls writeAudioToImage() to transcode audio data and write it to mapImage. If doResample is true, resamples files whose sample rate differs from the current audio output. If you want to load the image file and audio file separately, comment out writeAudioToImage().

Parameters:

audFile - an audio file

loadImageFile

public void loadImageFile(File imgFile)

Attempts to load image data from a selected file into mapImage, then calls writeImageToAudio() to transcode HSB brightness channel to audio and writes it to playBuffer and audioSignal.

Parameters:

imgFile - an image file

blendInto

public static void blendInto(ddf.minim.MultiChannelBuffer dest,
 ddf.minim.MultiChannelBuffer src,
 float weight,
 boolean normalize,
 float targetDB)

Blends audio data from buffer "src" into buffer "dest" in place. The formula per sample is: dest[i] = weight * src[i] + (1 - weight) * dest[i]

Parameters:

dest - Destination buffer (will be modified)

src - Source buffer to blend into dest

weight - Blend ratio (0.0 = keep dest, 1.0 = replace with src)

normalize

public static void normalize(float[] signal,
 float targetPeakDB)

Normalizes a single-channel signal array to a target RMS level in dBFS (decibels relative to full scale). 0 is the maximum digital amplitude. -6.0 dB is 50% of the maximum level.

Parameters:

signal -

targetPeakDB -

renderAudioToMapImage

public void renderAudioToMapImage(PixelAudioMapper.ChannelNames chan,
 int shift)

Transcodes audio data in audioSignal and writes it to color channel chan of mapImage.

Parameters:

chan - A color channel

shift - number of index positions to shift the audio signal

writeAudioToImage

public void writeAudioToImage(float[] sig,
 PixelAudioMapper mapper,
 processing.core.PImage img,
 PixelAudioMapper.ChannelNames chan,
 int shift)

Transcodes audio data in sig[] and writes it to color channel chan of img using the lookup tables in mapper to redirect indexing. Calls mapper.mapSigToImgShifted(), which will throw an IllegalArgumentException if sig.length != img.pixels.length or sig.length != mapper.getSize().

Parameters:

sig - an array of float, should be audio data in the range [-1.0, 1.0]

mapper - a PixelAudioMapper

img - a PImage

chan - a color channel

shift - the number of indices to shift when writing audio

writeAudioToImage

public void writeAudioToImage(float[] sig,
 PixelAudioMapper mapper,
 processing.core.PImage img,
 PixelAudioMapper.ChannelNames chan)

Transcodes audio data in sig[] and writes it to color channel chan of mapImage using the lookup tables in mapper to redirect indexing. Calls mapper.mapSigToImg(), which will throw an IllegalArgumentException if sig.length != img.pixels.length or sig.length != mapper.getSize(). We typically use PixelAudioMapper.ChannelNames.ALL or PixelAudioMapper.ChannelNames.L as the chan value. Both result in gray values, with PixelAudioMapper.ChannelNames.L maintaining previous hue and saturation color values in the image.

Parameters:

sig - an array of float, should be audio data in the range [-1.0, 1.0]

mapper - a PixelAudioMapper

img - a PImage

chan - a color channel

setAlphaWithBlack

public int setAlphaWithBlack(int argb,
 int alpha)

Sets the alpha channel of an RGBA color, conditionally setting alpha = 0 if all other channels = 0.

Parameters:

argb - an RGBA color value

alpha - the desired alpha value to apply to argb

Returns:

the argb color with changed alpha channel value

setAlpha

public static int setAlpha(int argb,
 int alpha)

Sets the alpha channel of an RGBA color.

Parameters:

argb - an RGBA color value

alpha - the desired alpha value to apply to argb

Returns:

the argb color with changed alpha channel value

writeImageToAudio

public void writeImageToAudio(processing.core.PImage img,
 PixelAudioMapper mapper,
 float[] sig,
 PixelAudioMapper.ChannelNames chan,
 int shift)

This method writes a color channel from an image to playBuffer, fulfilling a central concept of the PixelAudio library: image is sound. Calls mapper.mapImgToSig(), which will throw an IllegalArgumentException if img.pixels.length != sig.length or img.width * img.height != mapper.getWidth() * mapper.getHeight(). Sets totalShift = 0 on completion: the image and audio are now in sync.

Parameters:

img - a PImage, a source of data

mapper - a PixelAudioMapper, handles mapping between image and audio signal

sig - a target array of float in audio format

chan - a color channel

shift - number of indices to shift

renderMapImageToAudio

public void renderMapImageToAudio(PixelAudioMapper.ChannelNames chan)

Writes a specified channel of mapImage to audioSignal.

Parameters:

chan - the selected color channel

commitMapImageToAudio

public void commitMapImageToAudio()

commitMapImageToBaseImage

public void commitMapImageToBaseImage()

Writes the mapImage, which may change with animation, to the baseImage, a reference image that usually only changes when a new file is loaded.

commitNewBaseImage

public void commitNewBaseImage(processing.core.PImage img)

Copies the supplied PImage to mapImage and baseImage, sets totalShift to 0 (the images are identical).

Parameters:

img -

refreshMapImageFromBase

public void refreshMapImageFromBase()

Writes baseImage to mapImage with an index position offset of totalShift.

saveToAudio

public void saveToAudio()

Calls Processing's selectOutput method to start the process of saving the current audio signal to a .wav file.

audioFileSelectedWrite

public void audioFileSelectedWrite(File selection)

Parameters:

selection - a File to write as audio

saveAudioToFile

public void saveAudioToFile(float[] samples,
 float sampleRate,
 String fileName)
                     throws IOException,
UnsupportedAudioFileException

Saves audio data to 16-bit integer PCM format, which Processing can also open. This same method can be called as a static method in AudioUtility.

Parameters:

samples - an array of floats in the audio range (-1.0f, 1.0f)

sampleRate - audio sample rate for the file

fileName - name of the file to save to

Throws:

IOException - an Exception you'll need to handle to call this method

UnsupportedAudioFileException - another Exception

saveToImage

public void saveToImage()

Calls Processing's selectOutput method to start the process of saving the mapImage (the offscreen copy of the display image) to a .png file.

imageFileSelectedWrite

public void imageFileSelectedWrite(File selection)

saveImageToFile

public void saveImageToFile(processing.core.PImage img,
 String fileName)

initAudio

public void initAudio()

CALL THIS METHOD IN SETUP() Initializes Minim audio library and audio variables.

ensureSamplerReady

void ensureSamplerReady()

Prepares Sampler instruments and assets

ensureGranularReady

void ensureGranularReady()

Prepares Granular instruments and assets

initTimedEventLists

public void initTimedEventLists()

Initialize lists of TimedLocation objects, used for animated response to mouse clicks on brushstrokes and outside brushstrokes.

getSamplePos

public int getSamplePos(int x,
 int y)

Calculates the index of the image pixel within the signal path, taking the shifting of pixels and audioSignal into account. See MusicBoxBuffer for use of a windowed buffer in this calculation.

Parameters:

x - an x coordinate within mapImage and display bounds

y - a y coordinate within mapImage and display bounds

Returns:

the index of the sample corresponding to (x,y) on the signal path

getCoordFromSignalPos

public processing.core.PVector getCoordFromSignalPos(int pos)

Calculates the display image coordinates corresponding to a specified audio sample index.

Parameters:

pos - an index into an audio signal, must be between 0 and width * height - 1.

Returns:

a PVector with the x and y coordinates

updateAudioChain

void updateAudioChain(float[] sig,
 float bufferSampleRate)

Bottleneck "commit" method for audio state. Takes an arbitrary input signal and installs it as the canonical audio signal used by the application. This method: - Resizes/pads/truncates the input to mapper.getSize() - Copies the data to ensure no external aliasing - Updates audioSignal (canonical signal handled by application code) - Updates playBuffer (audio buffer used by Minim audio library methods) - Propagates the buffer to active instruments: edit for your own instruments This is the ONLY method that should mutate the global audio signal state. In PixelAudio examples, the signal is typically loaded from a file, but it could also be signal cached in memory, a signal generated by code, audio captured live, etc.

Parameters:

sig - an audio signal

bufferSampleRate - audio sample rate for sig, usually obtained when reading from an audio file

updateAudioChain

void updateAudioChain(float[] sig)

runSamplerPointEvent

void runSamplerPointEvent(int x,
 int y)

Plays a sample and animates a point

Parameters:

x - x-coordinate of event

y - y-coordinate of event

runGranularPointEvent

void runGranularPointEvent(int x,
 int y)

Plays a granular burst and animates a point

Parameters:

x - x-coordinate of event

y - y-coordinate of event

playGranularGesture

public void playGranularGesture(float[] buf,
 GestureSchedule sched,
 GestureGranularParams params)

Primary method for playing a granular synthesis audio event.

Parameters:

buf - an audio signal as a array of float

sched - GestureSchedule (points + times) for grains

params - core parameters for granular synthesis

debugIndexHeadroom

static void debugIndexHeadroom(float[] buf,
 int[] startIndices,
 GestureGranularParams ggp)

debugTimesMs

static void debugTimesMs(GestureSchedule s)

calculateEnvelopeDb

public ADSRParams calculateEnvelopeDb(float gainDb,
 int totalSamples,
 float sampleRate)

Calculate an envelope of length totalSamples.

Parameters:

gainDb - desired gain in dB, currently ignored

totalSamples - number of samples the envelope should cover

sampleRate - sample rate of the audio buffer the envelope is applied to

Returns:

and ADSRParams envelope

calculateEnvelopeLinear

public ADSRParams calculateEnvelopeLinear(float linear,
 float totalMs)

Calculate an envelope of length totalSamples.

Parameters:

linear - desired gain as a linear ratio, currently ignored

totalMs - desired duration of the envelope in milliseconds

Returns:

an ADSRParams envelope

playSample

public int playSample(int samplePos,
 int samplelen,
 float amplitude,
 float pan)

Plays an audio sample with default envelope and stereo pan.

Parameters:

samplePos - position of the sample in the audio buffer

samplelen - length of the sample (will be adjusted)

amplitude - amplitude of the sample on playback

pan - stereo pan [-1.0, 1.0] for sample

Returns:

the calculated sample length in samples

playSample

public int playSample(int samplePos,
 int samplelen,
 float amplitude,
 ADSRParams env,
 float pan)

Plays an audio sample with a custom envelope and stereo pan.

Parameters:

samplePos - position of the sample in the audio buffer

samplelen - length of the sample (will be adjusted)

amplitude - amplitude of the sample on playback

env - an ADSR envelope for the sample

pan - position of sound in the stereo audio field (-1.0 = left, 0.0 = center, 1.0 = right)

Returns:

the calculated sample length in samples

playSample

public int playSample(int samplePos,
 int samplelen,
 float amplitude,
 ADSRParams env,
 float pitch,
 float pan)

Plays an audio sample with with a custom envelope, pitch and stereo pan.

Parameters:

samplePos - position of the sample in the audio buffer

samplelen - length of the sample (will be adjusted)

amplitude - amplitude of the sample on playback

env - an ADSR envelope for the sample

pitch - pitch scaling as deviation from default (1.0), where 0.5 = octave lower, 2.0 = oactave higher

pan - position of sound in the stereo audio field (-1.0 = left, 0.0 = center, 1.0 = right)

Returns:

calcSampleLen

public int calcSampleLen(int dur,
 float mean,
 float variance)

Parameters:

dur - sample duration in milliseconds

mean - multiplier for duration, 1.0 leaves duration as mean value

variance - variance from mean value

Returns:

a length in samples with some Gaussian variation

calcSampleLen

public int calcSampleLen()

buildGranSynth

public PAGranularInstrument buildGranSynth(ddf.minim.AudioOutput out,
 ADSRParams env,
 int numVoices)

Initializes a PAGranularInstrument.

Parameters:

out - AudioOutput for this application

env - an ADSRParams envelope

numVoices - number of voices for the synth

Returns:

a PAGranularInstrument

initGranularParams

public void initGranularParams()

Initializes gParamsFixed, a GestureGranularParams instances used for granular point events.

applyColor

public int[] applyColor(int[] colorSource,
 int[] graySource,
 int[] lut)

Utility method for applying hue and saturation values from a source array of RGB values to the brightness values in a target array of RGB values, using a lookup table to redirect indexing.

Parameters:

colorSource - a source array of RGB data from which to obtain hue and saturation values

graySource - a target array of RGB data from which to obtain brightness values

lut - a lookup table, must be the same size as colorSource and graySource

Returns:

the graySource array of RGB values, with hue and saturation values changed

Throws:

IllegalArgumentException - if array arguments are null or if they are not the same length

applyColorShifted

public int[] applyColorShifted(int[] colorSource,
 int[] graySource,
 int[] lut,
 int shift)

Utility method for applying hue and saturation values from a source array of RGB values to the brightness values in a target array of RGB values, using a lookup table to redirect indexing, taking into account any pixels that were shifted.

Parameters:

colorSource - a source array of RGB data from which to obtain hue and saturation values

graySource - a target array of RGB data from which to obtain brightness values

lut - a lookup table, must be the same size as colorSource and graySource

shift - pixel shift from array rotation, windowed buffer, etc.

Returns:

the graySource array of RGB values, with hue and saturation values changed

Throws:

IllegalArgumentException - if array arguments are null or if they are not the same length

applyColorMap

public void applyColorMap()

Applies the Hue and Saturation of pixel values in the colors[] array to mapImage and baseImage.

initAllPoints

public void initAllPoints()

Initializes allPoints and adds the current mouse location to it.

handleClickOutsideBrush

public void handleClickOutsideBrush(int x,
 int y)

Respond to mousePressed events, usually by triggering an event

isOverAnyBrush

boolean isOverAnyBrush(int x,
 int y)

addDrawingPoint

public void addDrawingPoint(int x,
 int y)

While user is dragging the mouse and mode == Mode.DRAW_EDIT_GRANULAR or DRAW_EDIT_SAMPLER, accumulates new points to allPoints and event times to allTimes. Coordinates should be constrained to display window bounds.

clipToWidth

public int clipToWidth(int x)

Parameters:

x - a value to constrain to the current window width

Returns:

the constrained value

clipToHeight

public int clipToHeight(int y)

Parameters:

y - a value to constrain to the current window height

Returns:

the constrained value

jitterCoord

public processing.core.PVector jitterCoord(int x,
 int y,
 int deviationPx)

Displaces a supplied point by a random Gaussian variable.

Parameters:

x - x-coordinate

y - y-coordinate

deviationPx - average deviation, in pixels

Returns:

a displaced coordinate point as a PVector

generateJitterPitch

float[] generateJitterPitch(int length,
 float deviationPitch)

loadGestureSchedule

public GestureSchedule loadGestureSchedule(PACurveMaker brush,
 GestureGranularConfig snap)

Builds a GestureSchedule for a PACurveMaker brush and a snapshot of a GestureGranularConfig

Parameters:

brush - a PACurveMaker brush

snap - a snapshot of a GestureGranularConfig

Returns:

a GestureSchedule

initCurveMakerAndAddBrush

public AudioBrush initCurveMakerAndAddBrush()

Initializes a PACurveMaker instance with allPoints as an argument to the factory method PACurveMaker.buildCurveMaker() and then fills in PACurveMaker instance variables.

isBrushInteractable

boolean isBrushInteractable(AudioBrush b)

Parameters:

b - an AudioBrush instance

Returns:

return true if brush aligns with current drawingMode

setActiveBrush

void setActiveBrush(AudioBrush brush)

Assigns a brush to be the current active brush, accessible for editing and other options.

Parameters:

brush - an AudioBrush to assign

setActiveBrush

void setActiveBrush(AudioBrush brush,
 int idx)

recomputeUIBaselinesFromActiveBrush

void recomputeUIBaselinesFromActiveBrush()

Caching for UI settings, may be superfluous.

drawBrushShapes

public void drawBrushShapes()

Iterates over brushShapesList and draws the brushstrokes stored in each PACurveMaker in the list.

drawBrushes

public void drawBrushes(List<? extends AudioBrush> brushes,
 int readyColor,
 int hoverColor,
 int selectedColor)

Iterates over a brush list and draws the brushstrokes stored in each PACurveMaker in the list.

Parameters:

brushes -

readyColor -

hoverColor -

selectedColor -

getPathPoints

ArrayList<processing.core.PVector> getPathPoints(AudioBrush b)

Provides the list of points for a brush in its assigned PathMode representation.

Parameters:

b - an AudioBrush

Returns:

points in the path associated with the brush, as a list of PVector

getScheduleForBrush

public GestureSchedule getScheduleForBrush(AudioBrush b)

Parameters:

b - an AudioBrushLite instance

Returns:

GestureSchedule for the current pathMode of the brush

mouseInPoly

public boolean mouseInPoly(ArrayList<processing.core.PVector> poly)

Parameters:

poly - a polygon described by an ArrayList of PVector

Returns:

true if the mouse is within the bounds of the polygon, false otherwise

pointInPoly

public boolean pointInPoly(ArrayList<processing.core.PVector> poly,
 int x,
 int y)

Parameters:

poly - a polygon described by an ArrayList of PVector

x - x-coordinate

y - y-coordinate

Returns:

true if the mouse is within the bounds of the polygon, false otherwise

reset

public void reset(boolean isClearCurves)

Reinitializes audio and clears event lists. If isClearCurves is true, clears brushShapesList.

Parameters:

isClearCurves -

removeActiveBrush

public void removeActiveBrush()

Removes the current active PACurveMaker instance, flagged by a highlighted brush stroke, from brushShapesList, if there is one.

removeHoverBrush

public void removeHoverBrush()

Removes the current active PACurveMaker instance, flagged by a highlighted brush stroke, from brushShapesList, if there is one.

removeNewestBrush

public void removeNewestBrush()

Removes the newest PACurveMaker instance, shown as a brush stroke in the display, from brushShapesList.

removeOldestBrush

public void removeOldestBrush()

Removes the oldest brush in brushShapesList.

toggleBrushType

AudioBrush toggleBrushType(AudioBrush brush)

Convert a brush to the opposite type, reusing the same PACurveMaker and the same GestureGranularConfig.Builder instance. This is a replacement operation: the old brush should be removed from its list immediately after conversion.

Parameters:

brush - AudioBrush to convert, GranularBrush to/from SamplerBrush

toSamplerBrush

SamplerBrush toSamplerBrush(AudioBrush brush)

Convert a brush explicitly to SamplerBrush.

Parameters:

brush - an AudioBrush instance

Returns:

the brush reconfigured as a SamplerBrush

toGranularBrush

GranularBrush toGranularBrush(AudioBrush brush)

Convert a brush explicitly to GranularBrush.

Parameters:

brush - an AudioBrush instance

Returns:

the brush reconfigured as a GranularBrush

replaceBrush

void replaceBrush(AudioBrush oldBrush,
 AudioBrush newBrush,
 int oldIndex)

Remove oldBrush from its current typed list, insert newBrush into the opposite typed list, and preserve hover/active state. oldIndex should be the index in the old brush's own list.

appendGranularBrush

int appendGranularBrush(GranularBrush gb)

Append a granular brush and return its new index.

Parameters:

gb - a GranularBrush instance

Returns:

the index of the brush in the granularBrushes list

appendSamplerBrush

int appendSamplerBrush(SamplerBrush sb)

Append a sampler brush and return its new index.

Parameters:

sb - a SamplerBrush instance

Returns:

the index of the brush in the samplerBrushes list

removeGranularBrush

void removeGranularBrush(AudioBrush gb,
 int idx)

Remove a granular brush using index when reliable, else by object.

Parameters:

gb - an AudioBrush expected to be a GranularBrush

idx - index in the granular brush list, or a negative value when unknown

removeSamplerBrush

void removeSamplerBrush(AudioBrush sb,
 int idx)

Remove a sampler brush using index when reliable, else by object.

Parameters:

sb - an AudioBrush expected to be a SamplerBrush

idx - index in the sampler brush list, or a negative value when unknown

normalizeConfigForSampler

void normalizeConfigForSampler(GestureGranularConfig.Builder cfg)

Normalize config values when converting to SamplerBrush. Keep most gesture/path information intact.

Parameters:

cfg - a GestureGranularConfig.Builder instance

normalizeConfigForGranular

void normalizeConfigForGranular(GestureGranularConfig.Builder cfg)

Normalize config values when converting to GranularBrush. Keep most gesture/path information intact, but make a few granular-friendly adjustments.

Parameters:

cfg - a GestureGranularConfig.Builder instance

toggleHoveredBrushType

AudioBrush toggleHoveredBrushType()

Toggle the currently hovered brush between SamplerBrush and GranularBrush.

toggleActiveBrushType

AudioBrush toggleActiveBrushType()

Toggle the currently active brush between SamplerBrush and GranularBrush.

syncDrawingModeToBrush

void syncDrawingModeToBrush(AudioBrush brush)

Change the current DrawingMode to suit the brush passed as an argument.

Parameters:

brush - an AudioBrush instance

scheduleSamplerBrushClick

void scheduleSamplerBrushClick(SamplerBrush sb,
 int clickX,
 int clickY)

storeSamplerCurveTL

public void storeSamplerCurveTL(GestureSchedule sched,
 int startTime)

runSamplerBrushEvents

public void runSamplerBrushEvents()

scheduleGranularBrushClick

void scheduleGranularBrushClick(GranularBrush gb,
 int clickX,
 int clickY)

storeGranularCurveTL

public void storeGranularCurveTL(GestureSchedule sched,
 int startTime,
 boolean isGesture)

runGrainEvents

public void runGrainEvents()

Tracks and runs TimedLocation events in the grainLocsArray list, which is associated with granular synthesis gestures.

runPointEvents

public void runPointEvents()

Tracks and runs TimedLocation events in the timeLocsArray list, which is associated with mouse clicks that trigger audio a the click point.

drawCircle

public void drawCircle(int x,
 int y)

Draws a circle at the location of an audio trigger (mouseDown event).

Parameters:

x - x coordinate of circle

y - y coordinate of circle

initListener

public void initListener()

Sets up sample-accurate AudioListener called from the Minim audio processing loop. We use the samples() methods in the AudioListener interface to call our processAudioBlock() method. The audio samples don't concern us, just the regular interval over which they are processed: essentially, we have a timer that wakes up at a regular interval.

createGUI

public void createGUI()

Create all the GUI controls.

createControlWindow

public void createControlWindow()

Create a separate window for the GUI control palette.

createControlPanel

public void createControlPanel()

Create the GUI control palette.

createCommentsField

public void createCommentsField()

createControls

public void createControls()

Create all the controls in the control palette.

addControlsToPanel

public void addControlsToPanel()

Add the controls to the control palette.

winDraw

public void winDraw(processing.core.PApplet appc,
 g4p_controls.GWinData data)

isGuiTyping

boolean isGuiTyping()

winKey

public void winKey(processing.core.PApplet appc,
 g4p_controls.GWinData data,
 processing.event.KeyEvent evt)

controlPanel_hit

public void controlPanel_hit(g4p_controls.GPanel source,
 g4p_controls.GEvent event)

allOption_clicked

public void allOption_clicked(g4p_controls.GOption source,
 g4p_controls.GEvent event)

rdpOption_clicked

public void rdpOption_clicked(g4p_controls.GOption source,
 g4p_controls.GEvent event)

curveOption_clicked

public void curveOption_clicked(g4p_controls.GOption source,
 g4p_controls.GEvent event)

rdpEpsilonSlider_changed

public void rdpEpsilonSlider_changed(g4p_controls.GSlider source,
 g4p_controls.GEvent event)

curvePointsSlider_changed

public void curvePointsSlider_changed(g4p_controls.GSlider source,
 g4p_controls.GEvent event)

gestureOption_clicked

public void gestureOption_clicked(g4p_controls.GOption source,
 g4p_controls.GEvent event)

fixedOption_clicked

public void fixedOption_clicked(g4p_controls.GOption source,
 g4p_controls.GEvent event)

burstSlider_changed

public void burstSlider_changed(g4p_controls.GSlider source,
 g4p_controls.GEvent event)

resampleSlider_changed

public void resampleSlider_changed(g4p_controls.GSlider source,
 g4p_controls.GEvent event)

durationSlider_changed

public void durationSlider_changed(g4p_controls.GSlider source,
 g4p_controls.GEvent event)

grainLengthSlider_changed

public void grainLengthSlider_changed(g4p_controls.GSlider source,
 g4p_controls.GEvent event)

hopLengthSlider_changed

public void hopLengthSlider_changed(g4p_controls.GSlider source,
 g4p_controls.GEvent event)

grainLengthField_changed

public void grainLengthField_changed(g4p_controls.GTextField source,
 g4p_controls.GEvent event)

hopLengthField_changed

public void hopLengthField_changed(g4p_controls.GTextField source,
 g4p_controls.GEvent event)

pitchShiftText_changed

public void pitchShiftText_changed(g4p_controls.GTextField source,
 g4p_controls.GEvent event)

gainSlider_changed

public void gainSlider_changed(g4p_controls.GSlider source,
 g4p_controls.GEvent event)

linearWarpOption_clicked

public void linearWarpOption_clicked(g4p_controls.GOption source,
 g4p_controls.GEvent event)

expWarpOption_clicked

public void expWarpOption_clicked(g4p_controls.GOption source,
 g4p_controls.GEvent event)

squareRootOption_clicked

public void squareRootOption_clicked(g4p_controls.GOption source,
 g4p_controls.GEvent event)

customWarpOption_clicked

public void customWarpOption_clicked(g4p_controls.GOption source,
 g4p_controls.GEvent event)

warpSlider_changed

public void warpSlider_changed(g4p_controls.GSlider source,
 g4p_controls.GEvent event)

arcLengthTimeOption_clicked

public void arcLengthTimeOption_clicked(g4p_controls.GOption source,
 g4p_controls.GEvent event)

envelopeMenu_clicked

public void envelopeMenu_clicked(g4p_controls.GDropList source,
 g4p_controls.GEvent event)

printGConfigStatus

public void printGConfigStatus()

envPreset

static ADSRParams envPreset(String name)

Parameters:

name - the name of the ADSRParams envelope to return

Returns:

the specified ADSRParams envelope

nearlyEqual

static boolean nearlyEqual(float a,
 float b)

envEquals

static boolean envEquals(ADSRParams a,
 ADSRParams b)

envNameFor

String envNameFor(ADSRParams env)

envMenuIndex

int envMenuIndex(String name)

formatEnv

String formatEnv(ADSRParams env)

quantizeToStep

public static int quantizeToStep(int value,
 int step)

Quantize an integer to the nearest multiple of step.

syncGuiFromConfig

void syncGuiFromConfig()

Synchronize the control palette knobs to the current gConfig, probably because a brush was selected and made active.

clampInt

static int clampInt(int v,
 int lo,
 int hi)

setControlsEnabled

void setControlsEnabled()

Determine which controls to enable, based on the drawing mode.

isEditable

boolean isEditable()

resetToDefaults

void resetToDefaults()

printGOptHints

void printGOptHints(float alpha)

Print suggested values for optimizing grain overlap for a brush.

Parameters:

alpha -

calcGranularOptHints

public int calcGranularOptHints(String tag,
 int N,
 float Tms,
 int hopSamples,
 int grainLenSamples,
 float sr,
 List<processing.core.PVector> scheduledPoints,
 float targetSpacingPx,
 float wt,
 float ws,
 StringBuffer sb)

Calculate optimal configuration settings for a granular brush.

Returns:

optimal number of samples if time duration is kept as is

fmt

static String fmt(float v,
 int decimals)