Academic Commons Search Results
http://academiccommons.columbia.edu/catalog.rss?f%5Bsubject_facet%5D%5B%5D=Applied+mathematics&q=&rows=500&sort=record_creation_date+desc
Academic Commons Search Resultsen-usBayesian Hierarchical Rule Modeling for Predicting Medical Conditions
http://academiccommons.columbia.edu/catalog/ac:173882
McCormick, Tyler H.; Rudin, Cynthia; Madigan, David B.http://dx.doi.org/10.7916/D8V69GP1Wed, 14 May 2014 19:02:36 +0000We propose a statistical modeling technique, called the Hierarchical Association Rule Model (HARM), that predicts a patient’s possible future medical conditions given the patient’s current and past history of reported conditions. The core of our technique is a Bayesian hierarchical model for selecting predictive association rules (such as “condition 1 and condition 2 → condition 3”) from a large set of candidate rules. Because this method “borrows strength” using the conditions of many similar patients, it is able to provide predictions specialized to any given patient, even when little information about the patient’s history of conditions is available.Applied mathematics, Statistics, Medicinedm2418StatisticsArticlesLocation Estimation in Wireless Networks: A Bayesian Approach
http://academiccommons.columbia.edu/catalog/ac:173820
Madigan, David B.; Ju, Wen-Hua; Krishnan, P.; Krishnakumar, A. S. ; Zorych, Ivanhttp://dx.doi.org/10.7916/D82V2D74Tue, 13 May 2014 14:25:34 +0000We present a Bayesian hierarchical model for indoor location estimation in wireless networks. We demonstrate that out model achieves accuracy that is similar to other published models and algorithms. By harnessing prior knowledge, our model drastically reduces the requirement for training data as compared with existing approaches.Mathematics, Statistics, Applied mathematicsdm2418StatisticsArticlesComputer Graphics in the Solution of the Chain Deformation Problem
http://academiccommons.columbia.edu/catalog/ac:172760
Stellman, Steven D.http://dx.doi.org/10.7916/D8QR4V6PFri, 04 Apr 2014 16:22:22 +0000Go and Scheraga have given a general solution for determining the possible conformations of a section of a flexible polymeric chain between two fixed bonds (if the bonds coincide, the problem is equivalent to ring closure). Often, the fixed bonds are related by symmetry, such as that imposed by helicity or folding of antiparallel chains. A technique is shown for obtaining solutions using interactive computer graphics, whereby a plausible chain conformation or fold is approximated manually and completed by mathematical minimization. The procedure allows rapid, repetitive exploration of multiple solutions, and has many options for changing constraints. As an example, the backbone conformation of GpC, a dinucleoside phosphate, is used as a starting model, and gives upon minimization a set of backbone angles in the range of 11-fold helical RNA.Polymer chemistry, Applied mathematicssds91EpidemiologyArticlesA Spherical Chicken
http://academiccommons.columbia.edu/catalog/ac:172754
Stellman, Steven D.http://dx.doi.org/10.7916/D80863C7Fri, 04 Apr 2014 16:03:54 +0000Letter to the editor, published in Science (magazine).Biochemistry, Applied mathematicssds91EpidemiologyArticlesThermodyanic Properties of Poly(trans 1,4-butadiene) Crystals. Relationship to Molecular Structure
http://academiccommons.columbia.edu/catalog/ac:172751
Stellman, Jeanne M. ; Woodward, Arthur E. ; Stellman, Steven D.http://dx.doi.org/10.7916/D87S7KV1Fri, 04 Apr 2014 15:39:53 +0000Heat capacity measurements of melt crystallized poly( trans-1,4-butadiene) (PTBD) were carried out in the 50-130" region and the entropy change from 73" to the melting point, 139", was calculated. A value of the entropy change obtained using the rotational isomeric state approximation is found to underestimate the experimental entropy change. Theoretical energy calculations were carried out using empirical potential energy functions for a single PTBD chain, a unit cell and a lattice of cells. Minimization of the lattice energy with respect to two of the monoclinic cell constants for the low-temperature crystal form gave results in good agreement with X-ray diffraction data. The energy of transition from the low-temperature form was calculated and a theoretical heat capacity curve was obtained.Polymer chemistry, Applied mathematics, Chemistryjms13, sds91Health Policy and Management, Epidemiology, ChemistryArticlesConformation of Guanosine Cytidine 3',5'-Monophosphate (GpC)
http://academiccommons.columbia.edu/catalog/ac:172748
Stellman, Steven D. ; Hingerty, B. ; Broyde, S. B. ; Subramanian, E. ; Sato, T. ; Langridge, R.http://dx.doi.org/10.7916/D8CJ8BKRFri, 04 Apr 2014 15:27:37 +0000A brief communication of preliminary results of solution of dinucleoside phosphate GpC.Applied mathematics, Polymer chemistrysds91Epidemiology, ChemistryArticlesComputer Simulation of Polymer Conformation. II. Distribution Function for Polymers with Excluded Volume
http://academiccommons.columbia.edu/catalog/ac:172739
Stellman, Steven D.; Gans, Paul J.http://dx.doi.org/10.7916/D8SQ8XGWFri, 04 Apr 2014 14:33:33 +0000Numerical distributions of end-to-end distances were generated by a Monte Carlo method for hard-sphere off-lattice polymers of length N = 20, 40, 60, 80, 98, and 298 atoms. Comparison by xz tests against five recently proposed theoretical distribution functions showed that for N = 80 and N = 98, the data could be described, with 95% confidence, by the equation f(r) = exp[ -(ar2 + br + c)], where a and b are fitted parameters and c is a normalization constant. For N = 298, limitations of sample size lead to lower confidence limits (about 80%), but good fit. The above equation, and not its gaussian counterpart exp( -cr^2), is probably the limiting distribution function. The function accurately predicts the 1st through 12th observed moments at all chain lengths.Polymer chemistry, Applied mathematicssds91Epidemiology, ChemistryArticlesEfficient Computer Simulation of Polymer Conformation. I. Geometric Properties of the Hard-Sphere Model
http://academiccommons.columbia.edu/catalog/ac:172736
Stellman, Steven D. ; Gans, Paul J.http://dx.doi.org/10.7916/D8N58JF4Fri, 04 Apr 2014 12:15:01 +0000A system of efficient computer programs has been developed for simulating the conformations of macromolecules. The conformation of an individual polymer is defined as a point in conformation space, whose mutually orthogonal axes represent the successive dihedral angles of the backbone chain. The statistical-mechanical average of any property is obtained as the usual configuration integral over this space. A Monte Carlo method for estimating averages is used because of the impossibility of direct numerical integration. Monte Carlo corresponds to the execution of a Markoffian random walk of a representative point through the conformation space. Unlike many previous Monte Carlo studies of polymers, which sample conformation space indiscriminately, importance sampling increases efficiency because selection of new polymers is biased to reflect their Boltzmann probabilities in the canonical ensemble, leading to reduction of sampling variance and hence to greater accuracy! in given computing time. The simulation is illustrated in detail. Overall running time is proportional to n^(5/4), where n is the chain length. Results are presented for a hard-sphere linear polymer of n atoms, with free dihedral rotation, with n = 20-298. The fraction of polymers accepted in the importance sampling scheme, fA, is fit to a Fisher-Sykes attrition relation, giving an effective attrition constant of zero. fA is itself an upper bound to the partition function, Q, relative to the unrestricted walk. The mean-squared end-to-end distance and radius of gyration exhibit the expected exponential dependence, but with exponent for the radius of gyration significantly greater than that of the end-to-end distance. The 90% confidence limits calculated for both exponents did not include either 6/5 or 4/3, the lattice and zero-order perturbation values, respectively. A self-correcting scheme for generating coordinates free of roundoff error is given in an Appendix.Applied mathematics, Polymer chemistrysds91Epidemiology, ChemistryArticlesNonlinear Data Assimilation: Towards a Prediction of the Solar Cycle
http://academiccommons.columbia.edu/catalog/ac:171928
Svedin, Andreashttp://dx.doi.org/10.7916/D8TH8JR5Thu, 20 Mar 2014 17:35:34 +0000The solar cycle is the cyclic variation of solar activity, with a span of 9-14 years. The prediction of the solar cycle is an important and unsolved problem with implications for communications, aviation and other aspects of our high-tech society. Our interest is model-based prediction, and we present a self-consistent procedure for parameter estimation and model state estimation, even when only one of several model variables can be observed.
Data assimilation is the art of comparing, combining and transferring observed data into a mathematical model or computer simulation. We use the 3DVAR methodology, based on the notion of least squares, to present an implementation of a traditional data assimilation. Using the Shadowing Filter - a recently developed method for nonlinear data assimilation - we outline a path towards model based prediction of the solar cycle. To achieve this end we solve a number of methodological challenges related to unobserved variables. We also provide a new framework for interpretation that can guide future predictions of the Sun and other astrophysical objects.Astronomy, Astrophysics, Applied mathematicsaos2112AstronomyDissertationsLie-group interpolation and variational recovery for internal variables
http://academiccommons.columbia.edu/catalog/ac:171906
Mota, Alejandro; Sun, WaiChing; Ostien, Jakob T.; Long, Kevin N.; Foulk, James W.http://dx.doi.org/10.7916/D8H70CW9Wed, 19 Mar 2014 16:45:29 +0000We propose a variational procedure for the recovery of internal variables, in effect extending them from integration points to the entire domain. The objective is to perform the recovery with minimum error and at the same time guarantee that the internal variables remain in their admissible spaces. The minimization of the error is achieved by a three-field finite element formulation. The fields in the formulation are the deformation mapping, the target or mapped internal variables and a Lagrange multiplier that enforces the equality between the source and target internal variables. This formulation leads to an L2 projection that minimizes the distance between the source and target internal variables as measured in the L2 norm of the internal variable space. To ensure that the target internal variables remain in their original space, their interpolation is performed by recourse to Lie groups, which allows for direct polynomial interpolation of the corresponding Lie algebras b! y means of the logarithmic map. Once the Lie algebras are interpolated, the mapped variables are recovered by the exponential map, thus guaranteeing that they remain in the appropriate space.Theoretical mathematics, Applied mathematicsws2414Civil Engineering and Engineering MechanicsArticlesInfrastructure Scaling and Pricing
http://academiccommons.columbia.edu/catalog/ac:171000
Gocmen, Fikret Canerhttp://dx.doi.org/10.7916/D8SQ8XFFTue, 18 Feb 2014 12:15:29 +0000Infrastructure systems play a crucial role in our daily lives. They include, but are not limited to, the highways we take while we commute to work, the stadiums we go to watch games, and the power plants that provide the electricity we consume in our homes. In this thesis we study infrastructure systems from several different perspectives with a focus on pricing and scalability. The pricing aspect of our research focuses on two industries: toll roads and sports events. Afterwards, we analyze the potential impact of small modular infrastructure on a wide variety of industries. We start by analyzing the problem of determining the tolls that maximize revenue for a managed lane operator -- that is, an operator who can charge a toll for the use of some lanes on a highway while a number of parallel lanes remain free to use. Managing toll lanes for profit is becoming increasingly common as private contractors agree to build additional lane capacity in return for the opportunity to retain toll revenue. We start by modeling the lanes as queues and show that the dynamic revenue-maximizing toll is always greater than or equal to the myopic toll that maximizes expected revenue from each arriving vehicle. Numerical examples show that a dynamic revenue-maximizing toll scheme can generate significantly more expected revenue than either a myopic or a static toll scheme. An important implication is that the revenue-maximizing fee does not only depend on the current state, but also on anticipated future arrivals. We discuss the managerial implications and present several numerical examples. Next, we relax the queueing assumption and model traffic propagation on a highway realistically by using simulation. We devise a framework that can be used to obtain revenue maximizing tolls in such a context. We calibrate our framework by using data from the SR-91 Highway in Orange County, CA and explore different tolling schemes. Our numerical experiments suggest that simple dynamic tolling mechanisms can lead to substantial revenue improvements over myopic and time-of-use tolling policies. In the third part, we analyze the revenue management of consumer options for tournaments. Sporting event managers typically only offer advance tickets which guarantee a seat at a future sporting event in return for an upfront payment. Some event managers and ticket resellers have started to offer call options under which a customer can pay a small amount now for the guaranteed option to attend a future sporting event by paying an additional amount later. We consider the case of tournament options where the event manager sells team-specific options for a tournament final, such as the Super Bowl, before the finalists are determined. These options guarantee a final game ticket to the bearer if his team advances to the finals. We develop an approach by which an event manager can determine the revenue maximizing prices and amounts of advance tickets and options to sell for a tournament final. Afterwards, for a specific tournament structure we show that offering options is guaranteed to increase expected revenue for the event. We also establish bounds for the revenue improvement and show that introducing options can increase social welfare. We conclude by presenting a numerical application of our approach. Finally, we argue that advances made in automation, communication and manufacturing portend a dramatic reversal of the ``bigger is better'' approach to cost reductions prevalent in many basic infrastructure industries, e.g. transportation, electric power generation and raw material processing. We show that the traditional reductions in capital costs achieved by scaling up in size are generally matched by learning effects in the mass-production process when scaling up in numbers instead. In addition, using the U.S. electricity generation sector as a case study, we argue that the primary operating cost advantage of large unit scale is reduced labor, which can be eliminated by employing low-cost automation technologies. Finally, we argue that locational, operational and financial flexibilities that accompany smaller unit scale can reduce investment and operating costs even further. All these factors combined argue that with current technology, economies of numbers may well dominate economies of unit scale.Business, Operations research, Applied mathematicsBusinessDissertationsEfficient Computation of Polymer Conformation Energy
http://academiccommons.columbia.edu/catalog/ac:171438
Stellman, Steven D.; Froimowitz, Mark; Gans, Paul J.http://dx.doi.org/10.7916/D8W95757Fri, 14 Feb 2014 09:36:56 +0000Calculation of intramolecular energy of a polymer due to interactions of non-bonded atoms can be speeded up using simple geometric inequalities. This "zippering" method reduces time dependence of computation from n^2 to n^1.25, where n is the chain length. This technique is especially useful in applications of the pivot algorithm.Epidemiology, Applied mathematicssds91EpidemiologyArticlesToward an Understanding of Vertical Momentum Transports in Cloud-System-Resolving Model Simulations of Multiscale Tropical Convection
http://academiccommons.columbia.edu/catalog/ac:171435
Shaw, Tiffany A.; Lane, Todd P.http://dx.doi.org/10.7916/D80Z719SThu, 13 Feb 2014 17:22:38 +0000This study examines the characteristics of convective momentum transport (CMT) and gravity wave momentum transport (GWMT) in two-dimensional cloud-system-resolving model simulations, including the relationships between the two transports. A linear group velocity criterion is shown to objectively separate CMT and GWMT. The GWMT contribution is mostly consistent with upward-propagating gravity waves and is present in the troposphere and the stratosphere. The CMT contribution forms a large part of the residual (nonupward-propagating contribution) and dominates the fluxes in the troposphere. Additional analysis of the vertical sensible heat flux supports the physical interpretation of the two contributions, further isolating the effects of unstable convection from vertically propagating gravity waves. The role of transient and nonconservative (friction and diabatic heating) processes in generating momentum flux and their dependence on changes in convective organization was assessed using a pseudomomentum budget analysis. Nonconservative effects were found to dominate the transports; the GWMT contribution involved a diabatic source region in the troposphere and a dissipative sink region in the stratosphere. The CMT contribution was consistent with transport between the boundary layer and free troposphere via tilted convection. Transient buoyancy–vorticity correlations highlighted wave sources in the region of convective outflow and the boundary layer. These sources were akin to the previously described “mechanical oscillator” mechanism. Fluxes associated with this upper-level source were most sensitive to convective organization, highlighting the mechanism by which changes in organization are communicated to GWMT. The results elucidate important interactions between CMT and GWMT, adding further weight to suggestions that the two transports should be linked in parameterizations.Atmospheric sciences, Applied mathematicstas2163Earth and Environmental Sciences, Applied Physics and Applied MathematicsArticlesIntraseasonal and Interannual Variability in North American Storm Tracks and Its Relationship to Equatorial Pacific Variability
http://academiccommons.columbia.edu/catalog/ac:174585
Grise, Kevin Michael; Son, Seok-Woo; Gyakum, John R.http://dx.doi.org/10.7916/D89021RVFri, 24 Jan 2014 14:08:14 +0000Extratropical cyclones play a principal role in wintertime precipitation and severe weather over North America. On average, the greatest number of cyclones track 1) from the lee of the Rocky Mountains eastward across the Great Lakes and 2) over the Gulf Stream along the eastern coastline of North America. However, the cyclone tracks are highly variable within individual winters and between winter seasons. In this study, the authors apply a Lagrangian tracking algorithm to examine variability in extratropical cyclone tracks over North America during winter. A series of methodological criteria is used to isolate cyclone development and decay regions and to account for the elevated topography over western North America. The results confirm the signatures of four climate phenomena in the intraseasonal and interannual variability in North American cyclone tracks: the North Atlantic Oscillation (NAO), the El Niño–Southern Oscillation (ENSO), the Pacific–North American pattern (PNA), and the Madden–Julian oscillation (MJO). Similar signatures are found using Eulerian bandpass-filtered eddy variances. Variability in the number of extratropical cyclones at most locations in North America is linked to fluctuations in Rossby wave trains extending from the central tropical Pacific Ocean. Only over the far northeastern United States and northeastern Canada is cyclone variability strongly linked to the NAO. The results suggest that Pacific sector variability (ENSO, PNA, and MJO) is a key contributor to intraseasonal and interannual variability in the frequency of extratropical cyclones at most locations across North America.Atmospheric sciences, Meteorology, Applied mathematicskmg2164Lamont-Doherty Earth ObservatoryArticlesOptimal Monetary and Fiscal Policy: A Linear-Quadratic Approach
http://academiccommons.columbia.edu/catalog/ac:167750
Benigno, Pierpaolo; Woodford, Michaelhttp://dx.doi.org/10.7916/D8H70CRHMon, 25 Nov 2013 15:15:21 +0000We propose an integrated treatment of the problems of optimal monetary and fiscal policy, for an economy in which prices are sticky (so that the supply-side effects of tax changes are more complex than in standard fiscal analyses) and the only available sources of government revenue are distorting taxes (so that the fiscal consequences of monetary policy must be considered alongside the usual stabilization objectives). Our linear-quadratic approach allows us to nest both conventional analyses of optimal monetary stabilization policy and analyses of optimal tax-smoothing as special cases of our more general framework. We show how a linear-quadratic policy problem can be derived which yields a correct linear approximation to the optimal policy rules from the point of view of the maximization of expected discounted utility in a dynamic stochastic general-equilibrium model. Finally, in addition to characterizing the optimal dynamic responses to shocks under an optimal policy, we derive policy rules through which the monetary and fiscal authorities may implement the optimal equilibrium. These take the form of optimal targeting rules, specifying an appropriate target criterion for each authority.Economics, Economic theory, Applied mathematicsmw2230EconomicsConferencesSelf-fulfilling Prophecies and the Business Cycle
http://academiccommons.columbia.edu/catalog/ac:167746
Farmer, Roger E. A.; Woodford, Michaelhttp://dx.doi.org/10.7916/D8N014G7Mon, 25 Nov 2013 15:09:13 +0000We demonstrate that multiple stationary rational-expectations equilibria exist in a version of Lucas's island economy. The existence of these equilibria follows from the fact that there is an indeterminate set of monetary equilibria in the two-period overlapping-generations model. We show how to construct stationary rational-expectations equilibria by randomizing over the set of nonstationary monetary equilibria. In some of our equilibria, a positively sloped Phillips curve exists even though our economy contains no signal-extraction problem as in the original Lucas paper. Our equilibria are indexed by beliefs and are examples of the existence of sunspot equilibria in which allocations may differ across states of nature for which preferences, technology, and endowments are identical. Our technique for constructing stationary sunspot equilibria should prove useful in a wide class of models in which an indeterminate stationary equilibrium exists.Economics, Economic theory, Applied mathematicsmw2230EconomicsArticlesThree Questions about Sunspot Equilibria as an Explanation of Economic Fluctuations
http://academiccommons.columbia.edu/catalog/ac:167419
Woodford, Michaelhttp://dx.doi.org/10.7916/D8DZ0671Thu, 21 Nov 2013 16:41:51 +0000It is by now well known that the sort of difference equations that characterize the equilibrium conditions of an infinite horizon competitive economy may have solutions in which the endogenous variables fluctuate in response to "sunspot" variables, that is, to random events that in fact have nothing to do with economic "fundamentals," and so do not directly affect the equilibrium conditions. It is possible to view such "sunspot equilibria" as a representation of an actual phenomenon economic fluctuations not caused by exogenous shocks to fundamentals, but rather by revisions of agents' expectations in response to some event, which revised expectations become self-fulfilling.
Early discussions of such solutions sometimes suggested that a more rigorous derivation of the requirements for equilibrium might yield additional restrictions that would eliminate the sunspot solutions from the set of true equilibria. The demonstration by Karl Shell (1977), David Cass (1981), and Costas Azariadis (1981) that sunspot equilibria can exist in a rigorously formulated intertemporal equilibrium model, namely the overlapping generations model of Samuelson, has shown that this is not always the case. Nevertheless, many economists remain skeptical about the reasonableness of the sunspot hypothesis as a possible explanation of actual economic fluctuations, and for quite general reasons, independent of judgments about the empirical plausibility of any particular models. I discuss here three such general reasons for skepticism.Economics, Economic theory, Applied mathematicsmw2230EconomicsArticlesProduction of Heavy Particles by Protons on Protons
http://academiccommons.columbia.edu/catalog/ac:167194
Afek, Y.; Margolis, B.; Polvani, Lorenzo M.http://dx.doi.org/10.7916/D8JW8BSFTue, 19 Nov 2013 15:41:23 +0000We calculate the production of heavy particles in the multi-GeV energy range using parton-model and statistical considerations. We discuss both central production and fragmentation. Our picture has implications for the question of the existence of a limiting temperature in hadron interactions.Physics, Applied mathematicslmp3Applied Physics and Applied MathematicsArticlesGeneralized Kirchhoff Vortices
http://academiccommons.columbia.edu/catalog/ac:167191
Polvani, Lorenzo M.; Flierl, G. R.http://dx.doi.org/10.7916/D8PN93H5Tue, 19 Nov 2013 15:36:28 +0000A family of exact solutions of the Euler equations is presented: they are generalizations of the Kirchhoff vortex to N confocal ellipses. Special attention is given to the case N=2, for which the stability is analyzed with a method similar to the one used by Love [Proc. London Math. Soc. 1, XXV 18 (1893)] for the Kirchhoff vortex. The results are compared with those for the corresponding circular problem.Applied mathematics, Physicslmp3Applied Physics and Applied MathematicsArticlesWave–Wave Interaction of Unstable Baroclinic Waves
http://academiccommons.columbia.edu/catalog/ac:167188
Pedlosky, Joseph; Polvani, Lorenzo M.http://dx.doi.org/10.7916/D8TD9V7HTue, 19 Nov 2013 15:20:56 +0000Two slightly unstable baroclinic waves in the two-layer Phillips model are allowed to interact with each other as well as the mean flow. A theory for small dissipation rates is developed to examine the role of wave–wave interaction in the dynamics of vacillation and aperiodicity in unstable systems.
It is shown that the form of the dissipation mechanism as well as the overall dissipation timescale determines the nature of the dynamics. In particular, dissipation proportional to potential vorticity is shown to expunge amplitude vacillation due to wave–mean flow interactions.
Wave–wave interaction, however, can yield amplitude vacillation. As the dissipation is decreased, the solutions evolve from steady waves (although propagating) to periodic vacillation until finally at small dissipation rates, chaotic behavior is obtained.
This occurs in a range of relative growth rates of the two waves which depends on the strength of the wave–wave and wave–mean flow interactions.Atmospheric sciences, Applied mathematics, Physicslmp3Applied Physics and Applied MathematicsArticlesThe Effect of Dissipation on Spatially Growing Nonlinear Baroclinic Waves
http://academiccommons.columbia.edu/catalog/ac:167185
Polvani, Lorenzo M.; Pedlosky, J.http://dx.doi.org/10.7916/D8Z60KZCTue, 19 Nov 2013 15:16:34 +0000The question of convective (i.e., spatial) instability of baroclinic waves on an f-plane is studied in the context of the two-layer model. The viscous and inviscid marginal curves for linear convective instability are obtained. The finite-amplitude problem shows that when dissipation is O(1) it acts to stabilize the waves that are of Eady type. For very small dissipation the weakly nonlinear analysis reveals that at low frequencies, contrary to what is known to occur in the temporal problem, in addition to the baroclinic component a barotropic correction to the “mean” flow is generated by the nonlinearities, and spatial equilibration occurs provided the ratio of shear to mean flow does not exceed some critical value. In the same limit, the slightly dissipative nonlinear dynamics reveals the presence of large spatial vacillations immediately downstream of the source, even if asymptotically (i.e., very far away from the source) the amplitudes are found to reach steady values. No case of period doubling or aperiodic behavior was found. The results obtained seem to be qualitatively independent of the form chosen to model the dissipation.Atmospheric sciences, Physics, Applied mathematicslmp3Applied Physics and Applied MathematicsArticlesFilamentation of Unstable Vortex Structures via Separatrix Crossing: A Quantitative Estimate of Onset Time
http://academiccommons.columbia.edu/catalog/ac:167182
Polvani, Lorenzo M.; Flierl, G. R.; Zabusky, N. J.http://dx.doi.org/10.7916/D82Z13FRTue, 19 Nov 2013 15:09:06 +0000The onset of filamentation for compact vortex structures in two-dimensional incompressible flows is elucidated. An estimate is presented for the filamentation time of an unstably perturbed Kirchhoff ellipse, obtained from a linear analysis of the geometry of the instantaneous corotating streamfunction.Applied mathematics, Physicslmp3Applied Physics and Applied MathematicsArticlesTwo-Layer Geostrophic Vortex Dynamics. Part 1. Upper-Layer V-States and Merger
http://academiccommons.columbia.edu/catalog/ac:167179
Polvani, Lorenzo M.; Flierl, G. R.; Zabusky, N. J.http://dx.doi.org/10.7916/D86Q1V53Tue, 19 Nov 2013 15:02:02 +0000We generalize the methods of two-dimensional contour dynamics to study a two-layer rotating fluid that obeys the quasi-geostrophic equations. We consider here only the case of a constant-potential-vorticity lower layer. We derive equilibrium solutions for monopolar (rotating) and dipolar (translating) geostrophic vortices in the upper layer, and compare them with the Euler case. We show that the equivalent barotropic (infinite lower layer) case is a singular limit of the two-layer system. We also investigate the effect of a finite lower layer on the merger of two regions of equal-sign potential vorticity in the upper layer. We discuss our results in the light of the recent laboratory experiments of Griffiths and Hopfinger (1986). The process of filamentation is found to be greatly suppressed for equivalent barotropic dynamics on scales larger than the radius of deformation. We show that the variation of the critical initial distance for merger as a function of the radius of deformation and the ratio of the layers at rest is closely related to the existence of vortex-pair equilibria and their geometrical properties.Applied mathematics, Physics, Atmospheric scienceslmp3Applied Physics and Applied MathematicsArticlesChaotic Lagrangian Trajectories around an Elliptical Vortex Patch Embedded in a Constant and Uniform Background Shear Flow
http://academiccommons.columbia.edu/catalog/ac:167176
Polvani, Lorenzo M.; Wisdom, J.http://dx.doi.org/10.7916/D8BG2KWDTue, 19 Nov 2013 14:50:47 +0000The Lagrangian flow around a Kida vortex [J. Phys. Soc. Jpn. 5 0, 3517 (1981)], an elliptical two‐dimensional vortex patch embedded in a uniform and constant background shear, is described by a nonintegrable two‐degree‐of‐freedom Hamiltonian. For small values of shear, there exist large chaotic zones surrounding the vortex, often much larger than the vortex itself and extremely close to its boundary. Motion within the vortex is integrable. Implications for two‐dimensional turbulence are discussed.Physics, Applied mathematicslmp3Applied Physics and Applied MathematicsArticlesTwo-Layer Geostrophic Vortex Dynamics. Part 2. Alignment and Two-Layer V-States
http://academiccommons.columbia.edu/catalog/ac:167173
Lorenzo M., Polvanihttp://dx.doi.org/10.7916/D8G44N6TTue, 19 Nov 2013 13:38:39 +0000The process of alignment, a new fundamental interaction between vortices in a stratified and rapidly rotating fluid, is defined and studied in detail in the context of the two-layer quasi-geostrophic model. Alignment occurs when two vortices in different density layers coalesce by reducing their horizontal separation. It is found that only vortices whose radii are comparable with or larger than the Rossby deformation radius can align. In the same way as the merger process (in a single two dimensional layer) is related to the reverse energy cascade of two-dimensional turbulence, geostrophic potential vorticity alignment is related the barotropic-to baroclinic energy cascade of geostrophic turbulence in two layers. It is also shown how alignment is intimately connected with the existence of two-layer doubly connected geostrophic potential vorticity equilibria (V-states), for which the analysis of the geometry of the stream function in the corotating frame is found to be a crucial diagnostic. The finite-area analogues of the hetons of Hogg and Stommel (1985) are also determined : they consist of a propagating pair of opposite-signed potential vorticity patches located in different layers.Atmospheric sciences, Physics, Applied mathematicslmp3Applied Physics and Applied MathematicsArticlesThe Roll-Up of Vorticity Strips on the Surface of a Sphere
http://academiccommons.columbia.edu/catalog/ac:167167
Dritschel, David G.; Polvani, Lorenzo M.http://dx.doi.org/10.7916/D8QN64NJTue, 19 Nov 2013 10:15:53 +0000We derive the conditions for the stability of strips or filaments of vorticity on the surface of a sphere. We find that the spherical results are surprisingly different from the planar ones, owing to the nature of the spherical geometry. Strips of vorticity on the surface of a sphere show a greater tendency to roll-up into vortices than do strips on a planar surface.
The results are obtained by performing a linear stability analysis of the simplest, piecewise-constant vorticity configuration, namely a zonal band of uniform vorticity located in equilibrium between two latitudes. The presence of polar vortices is also considered, this having the effect of introducing adverse shear, a known stabilizing mechanism for planar flows. In several representative examples, the fully developed stages of the instabilities are illustrated by direct numerical simulation.
The implication for planetary atmospheres is that barotropic flows on the sphere have a more pronounced tendency to produce small, long-lived vortices, especially in equatorial and mid-latitude regions, than was previously anticipated from the theoretical results for planar flows. Essentially, the curvature of the sphere's surface weakens the interaction between different parts of the flow, enabling these parts to behave in relative isolation.Atmospheric sciences, Applied mathematics, Aeronomylmp3Applied Physics and Applied MathematicsArticlesWave and Vortex Dynamics on the Surface of a Sphere
http://academiccommons.columbia.edu/catalog/ac:167163
Polvani, Lorenzo M.; Dritschel, David G.http://dx.doi.org/10.7916/D8VD6WCWTue, 19 Nov 2013 09:59:28 +0000Motivated by the observed potential vorticity structure of the stratospheric polar vortex, we study the dynamics of linear and nonlinear waves on a zonal vorticity interface in a two-dimensional barotropic flow on the surface of a sphere (interfacial Rossby waves). After reviewing the linear problem, we determine, with the help of an iterative scheme, the shapes of steadily propagating nonlinear waves; a stability analysis reveals that they are (nonlinearly) stable up to very large amplitude.
We also consider multi-vortex equilibria on a sphere: we extend the results of Thompson (1883) and show that a (latitudinal) ring of point vortices is more unstable on the sphere than in the plane; notably, no more than three point vortices on the equator can be stable. We also determine the shapes of finite-area multi-vortex equilibria, and reveal additional modes of instability feeding off shape deformations which ultimately result in the complex merger of some or all of the vortices.
We discuss two specific applications to geophysical flows: for conditions similar to those of the wintertime terrestrial stratosphere, we show that perturbations to a polar vortex with azimuthal wavenumber 3 are close to being stationary, and hence are likely to be resonant with the tropospheric wave forcing; this is often observed in high-resolution numerical simulations as well as in the ozone data. Secondly, we show that the linear dispersion relation for interfacial Rossby waves yields a good fit to the phase velocity of the waves observed on Saturn’s ‘ribbon’.Atmospheric sciences, Applied mathematics, Aeronomylmp3Applied Physics and Applied MathematicsArticlesThe Coherent Structures of Shallowwater Turbulence: Deformationradius Effects, Cyclone/Anticyclone Asymmetry and Gravitywave Generation
http://academiccommons.columbia.edu/catalog/ac:167083
Polvani, Lorenzo M.; McWilliams, J. C.; Spall, M. A.; Ford, R.Fri, 08 Nov 2013 17:52:59 +0000Over a large range of Rossby and Froude numbers, we investigate the dynamics of initially balanced decaying turbulence in a shallow rotating fluid layer. As in the case of incompressible two‐dimensional decaying turbulence, coherent vortex structures spontaneously emerge from the initially random flow. However, owing to the presence of a free surface, a wealth of new phenomena appear in the shallow‐water system. The upscale energy cascade, common to strongly rotating flows, is arrested by the presence of a finite Rossby deformation radius. Moreover, in contrast to near‐geostrophic dynamics, a strong asymmetry is observed to develop as the Froude number is increased, leading to a clear dominance of anticyclonic vortices over cyclonic ones, even though no β effect is present in the system. Finally, we observe gravity waves to be generated around the vortex structures, and, in the strongest cases, they appear in the form of shocks. We briefly discuss the relevance of this study to the vortices observed in Jupiter’s atmosphere.Atmospheric sciences, Geophysics, Applied mathematicslmp3Applied Physics and Applied MathematicsArticlesThe Emergence of Jets and Vortices in Freely Evolving, Shallow‐Water Turbulence on a Sphere
http://academiccommons.columbia.edu/catalog/ac:167074
Cho, James Y‐K.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22171Fri, 08 Nov 2013 17:37:13 +0000Results from a series of simulations of unforced turbulence evolving within a shallow layer of fluid on a rotating sphere are presented. Simulations show that the turbulent evolution in the spherical domain is strongly dependent on numerical and physical conditions. The independent effects of (1) (hyper)dissipation and initial spectrum, (2) rotation rate, and (3) Rossby deformation radius are carefully isolated and studied in detail. In the nondivergent and nonrotating case, an initially turbulent flow evolves into a vorticityquadrupole at long times, a direct consequence of angular momentumconservation. In the presence of sufficiently strong rotation, the nondivergent long‐time behavior yields a field dominated by polar vortices—as previously reported by Yoden and Yamada. In contrast, the case with a finite deformation radius (i.e., the full spherical shallow‐water system) spontaneously evolves toward a banded configuration, the number of bands increasing with the rotation rate. A direct application of this shallow‐water model to the Jovian atmosphere is discussed. Using standard values for the planetary radius and rotation, we show how the initially turbulent flow self‐organizes into a potential vorticity field containing zonal structures, where regions of steep potential vorticity gradients (jets) separate relatively homogenized bands. Moreover, Jovian parameter values in our simulations lead to a strong vorticity asymmetry, favoring anticyclonic vortices—in further agreement with observations.Geophysics, Atmospheric sciences, Applied mathematicslmp3Applied Physics and Applied MathematicsArticlesTime-Dependent Fully Nonlinear Geostrophic Adjustment
http://academiccommons.columbia.edu/catalog/ac:167071
Kuo, Allen C.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22170Fri, 08 Nov 2013 17:33:37 +0000Shock-capturing numerical methods are employed to integrate the fully nonlinear, rotating 1D shallow-water equations starting from steplike nongeostrophic initial conditions (a Rossby adjustment problem). Such numerical methods allow one to observe the formation of multiple bores during the transient adjustment process as well as their decay due to rotation. It is demonstrated that increasing the rotation and/or the nonlinearity increases the rate of decay. Additionally, the time required for adjustment to be completed and its dependence on nonlinearity is examined; this time is found to be highly measure dependent. Lastly, the final adjusted state of the system is observed through long time integrations. Although the bores that form provide a mechanism for dissipation, their decay results in a final state in very good agreement with the one computed by well-known (dissipationless) conservation methods.Physics, Geophysics, Applied mathematicslmp3Applied Physics and Applied MathematicsArticlesBarotropic Vortex Pairs on a Rotating Sphere
http://academiccommons.columbia.edu/catalog/ac:167068
DiBattista, Mark T.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22169Fri, 08 Nov 2013 17:29:51 +0000Using a barotropic model in spherical geometry, we construct new solutions for steadily travelling vortex pairs and study their stability properties. We consider pairs composed of both point and finite-area vortices, and we represent the rotating background with a set of zonal strips of uniform vorticity. After constructing the solution for a single point-vortex pair, we embed it in a rotating background, and determine the equilibrium configurations that travel at constant speed without changing shape. For equilibrium solutions, we find that the stability depends on the relative strength (which may be positive or negative) of the vortex pair to the rotating background: eastward-travelling pairs are always stable, while westward-travelling pairs are unstable when their speeds approach that of the linear Rossby–Haurwitz waves. This finding also applies (with minor differences) to the case when the vortices are of finite area; in that case we find that, in addition to the point-vortex-like instabilities, the rotating background excites some finite-area instabilities for vortex pairs that would otherwise be stable. As for practical applications to blocking events, for which the slow westward pairs are relevant, our results indicate that free barotropic solutions are highly unstable, and thus suggest that forcing mechanisms must play an important role in maintaining atmospheric blocking events.Atmospheric sciences, Geophysics, Applied mathematicslmp3Applied Physics and Applied MathematicsArticlesThe Contour-Advective Semi-Lagrangian Algorithm for the Shallow Water Equations
http://academiccommons.columbia.edu/catalog/ac:167065
Dritschel, David G.; Polvani, Lorenzo M.; Mohebalhojeh, Ali R.http://hdl.handle.net/10022/AC:P:22168Fri, 08 Nov 2013 17:26:19 +0000A new method for integrating shallow water equations, the contour-advective semi-Lagrangian (CASL) algorithm, is presented. This is the first implementation of a contour method to a system of equations for which exact potential vorticity invertibility does not exist. The new CASL method fuses the recent contour-advection technique with the traditional pseudospectral (PS) method. The potential vorticity field, which typically develops steep gradients and evolves into thin filaments, is discretized by level sets separated by contours that are advected in a fully Lagrangian way. The height and divergence fields, which are intrinsically broader in scale, are treated in an Eulerian way: they are discretized on an fixed grid and time stepped with a PS scheme.
In fact, the CASL method is similar to the widely used semi-Lagrangian (SL) method in that material conservation of potential vorticity along particle trajectories is used to determine the potential vorticity at each time step from the previous one. The crucial difference is that, whereas in the CASL method the potential vorticity is merely advected, in the SL method the potential vorticity needs to be interpolated at each time step. This interpolation results in numerical diffusion in the SL method.
By directly comparing the CASL, SL, and PS methods, it is demonstrated that the implicit diffusion associated with potential vorticity interpolation in the SL method and the explicit diffusion required for numerical stability in the PS method seriously degrade the solution accuracy compared with the CASL method. Moreover, it is shown that the CASL method is much more efficient than the SL and PS methods since, for a given solution accuracy, a much coarser grid can be used and hence much faster computations can be performed.Atmospheric sciences, Applied mathematics, Geophysicslmp3Applied Physics and Applied MathematicsArticlesTime Variability and Simmons–Wallace–Branstator Instability in a Simple Nonlinear One-Layer Model
http://academiccommons.columbia.edu/catalog/ac:167062
Polvani, Lorenzo M.; Esler, J. Gavin; Plumb, R. Alanhttp://hdl.handle.net/10022/AC:P:22167Fri, 08 Nov 2013 17:22:20 +0000Using a global, one-layer shallow water model, the response of a westerly flow to a localized mountain is investigated. A steady, linear response at small mountain heights successively gives way first to a steady flow in which nonlinearities are important and then to unsteady, but periodic, flow at larger mountain heights. At first the unsteady behavior consists of a low-frequency oscillation of the entire Northern Hemisphere zonal flow. As the mountain height is increased further, however, the oscillatory behavior becomes localized in the diffluent jet exit region downstream of the mountain. The oscillation then takes the form of a relatively rapid vortex shedding event, followed by a gradual readjustment of the split jet structure in the diffluent region. Although relatively simple, the model exhibits a surprisingly high sensitivity to slight parameter changes. A linear stability analysis of the time-averaged flow is able to capture the transition from steady to time-dependent behavior, but fails to capture the transition between the two distinct regimes of time-dependent response. Moreover, the most unstable modes of the time-averaged flow are found to be stationary and fail to capture the salient features of the EOFs of the full time-dependent flow. These results therefore suggest that, even in the simplest cases, such as the one studied here, a linear analysis of the time-averaged flow can be highly inadequate in describing the full nonlinear behavior.Atmospheric sciences, Geophysics, Applied mathematicslmp3Applied Physics and Applied MathematicsArticlesOn the Mix-Down Times of Dynamically Active Potential Vorticity Filaments
http://academiccommons.columbia.edu/catalog/ac:167059
Esler, J. Gavin; Polvani, Lorenzo M.; Plumb, R. Alanhttp://hdl.handle.net/10022/AC:P:22166Fri, 08 Nov 2013 16:06:52 +0000A simple model is used to study the evolution of potential vorticity filaments, viewed in cross-section, subject to steady shear and deformation flows representative of the large-scale atmospheric circulation. It is found that
the balanced,ageostrophic circulation induced by the anomalous potential vorticity can cause the evolution of a dynamically active filament to differ substantially from that of a dynamically passive filament in a similar background flow. It is suggested that estimates of the mix-down time of material contained in atmospheric filaments need to be corrected to allow for this effect.Atmospheric sciences, Geophysics, Applied mathematicslmp3Applied Physics and Applied MathematicsArticlesWave-Vortex Interaction in Rotating Shallow Water. Part 1. One Space Dimension
http://academiccommons.columbia.edu/catalog/ac:167056
Kuo, Allen C.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22165Fri, 08 Nov 2013 16:01:40 +0000Using a physical space (i.e. non-modal) approach, we investigate interactions between fast inertio-gravity (IG) waves and slow balanced flows in a shallow rotating fluid. Specifically, we consider a train of IG waves impinging on a steady, exactly balanced vortex. For simplicity, the one-dimensional problem is studied first; the limitations of one-dimensionality are offset by the ability to define balance in an exact way. An asymptotic analysis of the problem in the small-amplitude limit is performed to demonstrate the existence of interactions. It is shown that these interactions are not confined to the modification of the wave field by the vortex but, more importantly, that the waves are able to alter in a non-trivial way the potential vorticity associated with that vortex. Interestingly, in this one-dimensional problem, once the waves have traversed the vortex region and have propagated away, the vortex exactly recovers its initial shape and thus bears no signature of the interaction. Furthermore, we prove this last result in the case of arbitrary vortex and wave amplitudes. Numerical integrations of the full one-dimensional shallow-water equations in strongly nonlinear regimes are also performed: they confirm that time-dependent interactions exist and increase with wave amplitude, while at the final state the vortex bears no sign of the interaction. In addition, they reveal that cyclonic vortices interact more strongly with the wave field than anticyclonic ones.Geophysics, Applied mathematics, Physicslmp3Applied Physics and Applied MathematicsArticlesNonlinear Geostrophic Adjustment, Cyclone/Anticyclone Asymmetry, and Potential Vorticity Rearrangement
http://academiccommons.columbia.edu/catalog/ac:167047
Kuo, Allen C.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22162Fri, 08 Nov 2013 14:20:08 +0000Within the context of the rotating shallow water equations, it is shown how initially unbalanced states possessing certain symmetries dynamically evolve to lose those symmetries during nonlinear geostrophic adjustment. Using conservation law methods, it is demonstrated that the adjustment of equal and opposite (circular) mass imbalances results in a balanced end state where cyclones are stronger than anticyclones; the reverse holds true for momentum imbalances. In both cases, the degree of this asymmetry is shown to be directly proportional to the amount of initial imbalance (a measure of the nonlinearity occurring during time-dependent adjustment). On the other hand, the degree of asymmetry is maximal for imbalances of Rossby deformation scale. As for the potential vorticity, it is shown that its final profile can be noticeably different from its initial one; from an Eulerian perspective, this rearrangement is not confined to uniform shifts of potential vorticity fronts. Direct 2D numerical initial value problems confirm the asymmetry in the predicted final states and establish a relatively fast time scale for adjustment to complete. The robustness of these results is confirmed by studying, in addition, the adjustment of elliptical mass imbalances. The numerical integrations reveal that, during geostrophic adjustment, potential vorticity rearrangement occurs irreversibly on a fast wave time scale.Physics, Geophysics, Applied mathematicslmp3Applied Physics and Applied MathematicsArticlesThe Hadley Circulation and the Weak Temperature Gradient Approximation
http://academiccommons.columbia.edu/catalog/ac:166986
Polvani, Lorenzo M.; Sobel, Adam H.http://hdl.handle.net/10022/AC:P:22137Mon, 04 Nov 2013 16:33:27 +0000The weak temperature gradient (WTG) approximation is applied to simple shallow-water models of the Hadley circulation. While it is difficult to formally justify the use of the WTG approximation for this problem, the derived WTG solutions are shown to agree well with numerical solutions of the full equations and to converge to the traditional angular momentum conserving (AMC) solutions in the inviscid limit. Heuristic arguments are given to explain this. The WTG method also provides semianalytical solutions in the case of nonvanishing viscosity, in contrast to the AMC solutions, which are strictly inviscid.Atmospheric sciences, Meteorology, Applied mathematicslmp3, ahs129Applied Physics and Applied Mathematics, Earth and Environmental SciencesArticlesNumerically Converged Solutions of the Global Primitive Equations for Testing the Dynamical Core of Atmospheric GCMs
http://academiccommons.columbia.edu/catalog/ac:166983
Polvani, Lorenzo M.; Scott, R. K.; Thomas, S. J.http://hdl.handle.net/10022/AC:P:22136Mon, 04 Nov 2013 16:29:31 +0000Solutions of the dry, adiabatic, primitive equations are computed, for the first time, to numerical convergence. These solutions consist of the short-time evolution of a slightly perturbed, baroclinically unstable, midlatitude jet, initially similar to the archetypal LC1 case of Thorncroft et al. The solutions are computed with two distinct numerical schemes to demonstrate that they are not dependent on the method used to obtain them.
These solutions are used to propose a new test case for dynamical cores of atmospheric general circulation models. Instantaneous horizontal and vertical cross sections of vorticity and vertical velocity after 12 days, together with tables of key diagnostic quantities derived from the new solutions, are offered as reproducible benchmarks. Unlike the Held and Suarez benchmark, the partial differential equations and the initial conditions are here completely specified, and the new test case requires only 12 days of integration, involves no spatial or temporal averaging, and does not call for physical parameterizations to be added to the dynamical core itself.Atmospheric sciences, Meteorology, Applied mathematicslmp3Applied Physics and Applied Mathematics, Earth and Environmental SciencesArticlesKelvin–Helmholtz Instability of Potential Vorticity Layers: A Route to Mixing
http://academiccommons.columbia.edu/catalog/ac:166980
Esler, J. G.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22135Mon, 04 Nov 2013 16:26:02 +0000The linear and nonlinear dynamics of layers of anomalously high potential vorticity (PV) are studied in detail. It is well known that PV layers are subject to slow, balanced, mixed barotropic–baroclinic instabilities. In this paper, it is shown that, in addition, PV layers are subject to a Kelvin–Helmholtz instability, operating on much smaller spatial and faster temporal scales.
For simplicity, spatially infinite layers of uniform anomalous PV are considered. Such layers are characterized by two key parameters: the ratio Δq of their anomalous PV to the background PV, and the angle α between the layer and the direction of the ambient stratification gradient (in suitably scaled coordinates). It is found that Kelvin–Helmholtz appears, for certain values of α, whenever Δq greater than 8.
Of notable interest is the case of an initially vertical PV layer embedded in a weak ambient shear flow: for sufficiently large Δq, once the PV layer is tilted past a critical angle, Kelvin–Helmholtz instability becomes possible. It is argued that the breakdown of PV layers due to a Kelvin–Helmholtz instability induced by ambient shear might be an important systematic mechanism leading to irreversible mixing during stratosphere–troposphere exchange events. This is discussed in the context of an example of Kelvin–Helmholtz instability observed near a tropopause fold.Atmospheric sciences, Aeronomy, Applied mathematicslmp3Applied Physics and Applied MathematicsArticlesStratosphere–Troposphere Coupling in a Relatively Simple AGCM: The Role of Eddies
http://academiccommons.columbia.edu/catalog/ac:166971
Kushner, Paul J.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22132Mon, 04 Nov 2013 16:12:43 +0000The extratropical circulation response to cooling of the polar-winter stratosphere in a simple AGCM is investigated. The AGCM is a dry hydrostatic primitive equation model with zonally symmetric boundary conditions and analytically specified physics. It is found that, as the polar-winter stratosphere is cooled, the tropospheric jet shifts poleward. This response projects almost entirely and positively (by convention) onto the AGCM's annular mode. At the same time, the vertical flux of wave activity from the troposphere to the stratosphere is reduced and the meridional flux of wave activity from high to low latitudes is increased. Thus, as the stratosphere is cooled, the stratospheric wave drag is reduced.
In order to understand this response, the transient adjustment of the stratosphere–troposphere system is investigated using an ensemble of “switch on” stratospheric cooling runs of the AGCM. The response to the switch-on stratospheric cooling descends from the upper stratosphere into the troposphere on a time scale that matches simple downward-control theory estimates.
The downward-control analysis is pursued with a zonally symmetric model that uses as input the thermal and eddy-driving terms from the eddying AGCM. With this model, the contributions to the response from the thermal and eddy-driving perturbations can be investigated separately, in the absence of eddy feedbacks. It is found that the stratospheric thermal perturbation, in the absence of such feedbacks, induces a response that is confined to the stratosphere. The stratospheric eddy-driving perturbation, on the other hand, induces a response that penetrates into the midtroposphere but does not account, in the zonally symmetric model, for the tropospheric jet shift. Furthermore, the tropospheric eddy-driving perturbation, in the zonally symmetric model, induces a strong upward response in the stratospheric winds. From these experiments and from additional experiments with the eddying AGCM, it is concluded that the stratospheric eddy-driving response induces a tropospheric response, but that the full circulation response results from a two-way coupling between the stratosphere and the troposphere.Atmospheric sciences, Aeronomy, Applied mathematicslmp3Applied Physics and Applied Mathematics, Earth and Environmental SciencesArticlesStratospheric Influence on Baroclinic Lifecycles and its Connection to the Arctic Oscillation
http://academiccommons.columbia.edu/catalog/ac:166968
Wittman, Matthew A. H.; Polvani, Lorenzo M.; Charlton, Andrew J.; Scott, Richard K.http://hdl.handle.net/10022/AC:P:22131Mon, 04 Nov 2013 16:07:42 +0000Using an idealized primitive equation model, we investigate how stratospheric conditions alter the development of baroclinic instability in the troposphere. Starting from the lifecycle paradigm of Thorncroft et al., we consider the evolution of baroclinic lifecycles resulting from the addition of a stratospheric jet to the LC1 initial condition. We find that the addition of the stratospheric jet yields a net surface geopotential height anomaly that strongly resembles the Arctic Oscillation. With the additional modification of the tropospheric winds to resemble the high-AO climatology, the surface response is amplified by a factor 10 and, though dominated by the tropospheric changes, shows similar sensitivity to the stratospheric conditions.Atmospheric sciences, Applied mathematics, Aeronomymaw2006, lmp3, ac2343Applied Physics and Applied Mathematics, Earth and Environmental SciencesArticlesStratospheric Control of Upward Wave Flux near the Tropopause
http://academiccommons.columbia.edu/catalog/ac:166965
Scott, R. K.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22130Mon, 04 Nov 2013 16:03:11 +0000Using an idealized, global primitive equation model of the stratosphere-troposphere system in which all tropospheric variability is surpressed, we demonstrate the existence of internal modes of stratospheric variability. The variability in our model is similar to that observed in the winter stratosphere, consisting of sudden-warming like, wave-driven decelerations of the polar vortex followed by a more gradual re-establishment of the vortex by the radiative forcing. Using a common index of the strength of the stratospheric vortex, we find patterns of downward propagation resembling those found in recent observations. In addition, our model exhibits considerable variability in the upward flux of wave activity into the stratosphere; this variability strongly anti-correlates with the index of the mid-upper stratospheric vortex, again in agreement with recent observations.Atmospheric sciences, Applied mathematics, Aeronomylmp3Applied Physics and Applied MathematicsArticlesOn the Meridional Structure of Annular Modes
http://academiccommons.columbia.edu/catalog/ac:166962
Wittman, Matthew A. H.; Charlton, Andrew J.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22129Mon, 04 Nov 2013 15:57:44 +0000Using a simple stochastic model, the authors illustrate that the occurrence of a meridional dipole in the first empirical orthogonal function (EOF) of a time-dependent zonal jet is a simple consequence of the north–south excursion of the jet center, and this geometrical fact can be understood without appealing to fluid dynamical principles. From this it follows that one ought not, perhaps, be surprised at the fact that such dipoles, commonly referred to as the Arctic Oscillation (AO) or the Northern Annular Mode (NAM), have robustly been identified in many observational studies and appear to be ubiquitous in atmospheric models across a wide range of complexity.Atmospheric sciences, Aeronomy, Applied mathematicsmaw2006, ac2343, lmp3Applied Physics and Applied Mathematics, Earth and Environmental SciencesArticlesThe Coupled Stratosphere–Troposphere Response to Impulsive Forcing from the Troposphere
http://academiccommons.columbia.edu/catalog/ac:166959
Reichler, Thomas; Kushner, Paul J.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22128Mon, 04 Nov 2013 15:53:51 +0000A simple atmospheric general circulation model (GCM) is used to investigate the transient response of the stratosphere–troposphere system to externally imposed pulses of lower-tropospheric planetary wave activity. The atmospheric GCM is a dry, hydrostatic, global primitive-equations model, whose circulation includes an active polar vortex and a tropospheric jet maintained by baroclinic eddies. Planetary wave activity pulses are generated by a perturbation of the solid lower boundary that grow and decay over a period of 10 days. The planetary wave pulses propagate upward and break in the stratosphere. Subsequently, a zonal-mean circulation anomaly propagates downward, often into the troposphere, at lags of 30–100 days. The evolution of the response is found to be dependent on the state of the stratosphere–troposphere system at the time the pulse is generated. In particular, on the basis of a large ensemble of these simulations, it is found that the length of time the signal takes to propagate downward from the stratosphere is controlled by initial anomalies in the zonal-mean circulation and in the zonal-mean wave drag. Criteria based on these anomaly patterns can be used, therefore, to predict the long-term surface response of the stratosphere–troposphere system to a planetary wave pulse up to 90 days after the pulse is generated. In an independent test, it is verified that the initial states that most strongly satisfy these criteria respond in the expected way to the lower-tropospheric wave activity pulse.Atmospheric sciences, Aeronomy, Applied mathematicslmp3Applied Physics and Applied MathematicsArticlesA Very Large, Spontaneous Stratospheric Sudden Warming in a Simple AGCM: A Prototype for the Southern Hemisphere Warming of 2002?
http://academiccommons.columbia.edu/catalog/ac:166956
Kushner, Paul J.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22127Mon, 04 Nov 2013 15:48:40 +0000An exceptionally strong stratospheric sudden warming (SSW) that spontaneously occurs in a very simple stratosphere–troposphere AGCM is discussed. The model is a dry, hydrostatic, primitive equation model without planetary stationary waves. Transient baroclinic wave–wave interaction in the troposphere thus provides the only source of upward-propagating wave activity into the stratosphere. The model’s SSW is grossly similar to the Southern Hemisphere major SSW of 2002: it occurs after weaker warmings “precondition” the polar vortex for breaking, it involves a split of the polar vortex, and it has a downward-propagating signature. These similarities suggest that the Southern Hemisphere SSW of 2002 might itself have been caused by transient baroclinic wave–wave interaction. The simple model used for this study also provides some insight into how often such extreme events might occur. The frequency distribution of SSWs in the model has exponential, as opposed to Gaussian, tails. This suggests that very large amplitude SSWs, though rare, might occur with higher frequency than might be naively expected.Atmospheric sciences, Aeronomy, Applied mathematicslmp3Applied Physics and Applied Mathematics, Earth and Environmental SciencesArticlesStratosphere–Troposphere Coupling in a Relatively Simple AGCM: Impact of the Seasonal Cycle
http://academiccommons.columbia.edu/catalog/ac:166953
Kushner, Paul J.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22126Mon, 04 Nov 2013 15:43:52 +0000The seasonal time dependence of the tropospheric circulation response to polar stratospheric cooling in a simple atmospheric general circulation model is investigated. When the model is run without a seasonal cycle, polar stratospheric cooling induces a positive annular-mode response in the troposphere that takes a remarkably long time—several hundred days—to fully equilibrate. One is thus led to ask whether the tropospheric response would survive in the presence of a seasonal cycle. When a seasonal cycle is introduced into the model stratosphere, the tropospheric response appears with a distinct time lag with respect to the stratospheric cooling, but, in the long-term mean, the pattern of the wind response is very similar to the one that results from stratospheric forcing in the absence of a seasonal cycle.Atmospheric sciences, Aeronomy, Applied mathematicslmp3Applied Physics and Applied Mathematics, Earth and Environmental SciencesArticlesInternal Variability of the Winter Stratosphere. Part I: Time-Independent Forcing
http://academiccommons.columbia.edu/catalog/ac:166950
Scott, R. K.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22125Mon, 04 Nov 2013 15:33:01 +0000This paper examines the nature and robustness of internal stratospheric variability, namely the variability resulting from the internal dynamics of the stratosphere itself, as opposed to that forced by external sources such as the natural variability of the free troposphere. Internal stratospheric variability arises from the competing actions of radiative forcing, which under perpetual winter conditions strengthens the polar vortex, and planetary wave breaking, which weakens it. The results from a stratosphere-only model demonstrate that strong internal stratospheric variability, consisting of repeated sudden warming-type events, exists over a wide range of realistic radiative and wave forcing conditions, and is largely independent of other physical and numerical parameters. In particular, the coherent form of the variability persists as the number of degrees of freedom is increased, and is therefore not an artifact of severe model truncation. Various diagnostics, including three-dimensional representations of the potential vorticity, illustrate that the variability is determined by the vertical structure of the vortex and the extent to which upward wave propagation is favored or inhibited. In this paper, the variability arising from purely internal stratosphere dynamics is isolated by specifying thermal and wave forcings that are completely time independent. In a second paper, the authors investigate the relative importance of internal and external variability by considering time-dependent wave forcing as a simple representation of tropospheric variability.Atmospheric sciences, Aeronomy, Applied mathematicslmp3Applied Physics and Applied MathematicsArticlesA New Look at Stratospheric Sudden Warmings. Part I: Climatology and
Modeling Benchmarks
http://academiccommons.columbia.edu/catalog/ac:166927
Charlton, Andrew J.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22113Mon, 04 Nov 2013 11:46:47 +0000Stratospheric sudden warmings are the clearest and strongest manifestation of dynamical coupling in the stratosphere–troposphere system. While many sudden warmings have been individually documented in the literature, this study aims at constructing a comprehensive climatology: all major midwinter warming events are identified and classified, in both the NCEP–NCAR and 40-yr ECMWF Re-Analysis (ERA-40) datasets. To accomplish this a new, objective identification algorithm is developed. This algorithm identifies sudden warmings based on the zonal mean zonal wind at 60°N and 10 hPa, and classifies them into events that do and do not split the stratospheric polar vortex.
Major midwinter stratospheric sudden warmings are found to occur with a frequency of approximately six events per decade, and 46% of warming events lead to a splitting of the stratospheric polar vortex. The dynamics of vortex splitting events is contrasted to that of events where the vortex is merely displaced off the pole. In the stratosphere, the two types of events are found to be dynamically distinct: vortex splitting events occur after a clear preconditioning of the polar vortex, and their influence on middle-stratospheric temperatures lasts for up to 20 days longer than vortex displacement events. In contrast, the influence of sudden warmings on the tropospheric state is found to be largely insensitive to the event type.
Finally, a table of dynamical benchmarks for major stratospheric sudden warming events is compiled. These benchmarks are used in a companion study to evaluate current numerical model simulations of the stratosphere.Atmospheric sciences, Aeronomy, Applied mathematicsac2343, lmp3Applied Physics and Applied Mathematics, Earth and Environmental SciencesArticlesA New Look at Stratospheric Sudden Warmings. Part II: Evaluation of Numerical Model Simulations
http://academiccommons.columbia.edu/catalog/ac:166924
Charlton, Andrew J.; Polvani, Lorenzo M.; Perlwitz, Judith; Sassi, Fabrizio; Manzini, Elisa; Pawson, Steven; Shibata, Kiyotaka; Nielsen, J. Eric; Rind, Davidhttp://hdl.handle.net/10022/AC:P:22113Mon, 04 Nov 2013 11:30:28 +0000The simulation of major midwinter stratospheric sudden warmings (SSWs) in six stratosphere-resolving general circulation models (GCMs) is examined. The GCMs are compared to a new climatology of SSWs, based on the dynamical characteristics of the events. First, the number, type, and temporal distribution of SSW events are evaluated. Most of the models show a lower frequency of SSW events than the climatology, which has a mean frequency of 6.0 SSWs per decade. Statistical tests show that three of the six models produce significantly fewer SSWs than the climatology, between 1.0 and 2.6 SSWs per decade. Second, four process-based diagnostics are calculated for all of the SSW events in each model. It is found that SSWs in the GCMs compare favorably with dynamical benchmarks for SSW established in the first part of the study.
These results indicate that GCMs are capable of quite accurately simulating the dynamics required to produce SSWs, but with lower frequency than the climatology. Further dynamical diagnostics hint that, in at least one case, this is due to a lack of meridional heat flux in the lower stratosphere. Even though the SSWs simulated by most GCMs are dynamically realistic when compared to the NCEP–NCAR reanalysis, the reasons for the relative paucity of SSWs in GCMs remains an important and open question.Atmospheric sciences, Aeronomy, Applied mathematicsac2343, lmp3Applied Physics and Applied Mathematics, Earth and Environmental SciencesArticlesForced-Dissipative Shallow-Water Turbulence on the Sphere and the Atmospheric Circulation of the Giant Planets
http://academiccommons.columbia.edu/catalog/ac:166921
Scott, R. K.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22112Mon, 04 Nov 2013 11:25:43 +0000Although possibly the simplest model for the atmospheres of the giant planets, the turbulent forced-dissipative shallow-water system in spherical geometry has not, to date, been investigated; the present study aims to fill this gap. Unlike the freely decaying shallow-water system described by Cho and Polvani, equilibrium states in the forced-dissipative system are highly dependent on details of the forcing and the dissipation. For instance, it is found that for a given equilibrated energy level, the steadiness of zonal jets depends crucially on the balance between forcing and dissipation.
With long (up to 100 000 days) high-resolution (T170) calculations, the dependence of the equilibrium states on Rossby number Ro and Rossby deformation radius LD is explored, for the case when the dissipation takes the form of hypodiffusion (acting predominantly at large scales) and the random forcing at small scales is δ correlated in time. When LD is large compared to the planetary radius, zonal jets are verified to scale closely with the Rhines scale over a wide range of Ro; furthermore, the jets at the equator are found to be both prograde and retrograde with approximately equal likelihood. As LD is decreased, the equatorial jets become increasingly and consistently retrograde, in agreement with the freely decaying turbulence results. Also, the regime recently discussed by Theiss, where zonal jets are confined to low latitudes, is illustrated to emerge robustly in the limit of small LD. Finally, specific calculations with parameter values typical of the giant planets are presented, confirming many of the earlier results obtained in the freely decaying case.Atmospheric sciences, Applied mathematics, Planetologylmp3Applied Physics and Applied MathematicsArticlesThe Effect of Lower Stratospheric Shear on Baroclinic Instability
http://academiccommons.columbia.edu/catalog/ac:166918
Wittman, Matthew A. H.; Charlton, Andrew J.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22111Mon, 04 Nov 2013 11:20:10 +0000Using a hierarchy of models, and observations, the effect of vertical shear in the lower stratosphere on baroclinic instability in the tropospheric midlatitude jet is examined. It is found that increasing stratospheric shear increases the phase speed of growing baroclinic waves, increases the growth rate of modes with low synoptic wavenumbers, and decreases the growth rate of modes with higher wavenumbers. The meridional structure of the linear modes, and their acceleration of the zonal mean jet, changes with increasing stratospheric shear, but in a way that apparently contradicts the observed stratosphere–troposphere northern annular mode (NAM) connection. This contradiction is resolved at finite amplitude. In nonlinear life cycle experiments it is found that increasing stratospheric shear, without changing the jet structure in the troposphere, produces a transition from anticyclonic (LC1) to cyclonic (LC2) behavior at wavenumber 7. All life cycles with wavenumbers lower than 7 are LC1, and all with wavenumber greater than 7 are LC2. For the LC1 life cycles, the effect of increasing stratospheric shear is to increase the poleward displacement of the zonal mean jet by the eddies, which is consistent with the observed stratosphere–troposphere NAM connection. Finally, it is found that the connection between high stratospheric shear and high-tropospheric NAM is present by NCEP–NCAR reanalysis data.Atmospheric sciences, Aeronomy, Applied mathematicsmaw2006, ac2343, lmp3Applied Physics and Applied Mathematics, Earth and Environmental SciencesArticlesTesting the Annular Mode Autocorrelation Time Scale in Simple Atmospheric General Circulation Models
http://academiccommons.columbia.edu/catalog/ac:166909
Gerber, Edwin P.; Voronin, Sergey; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22108Mon, 04 Nov 2013 10:52:18 +0000A new diagnostic for measuring the ability of atmospheric models to reproduce realistic low-frequency variability is introduced in the context of Held and Suarez’s 1994 proposal for comparing the dynamics of different general circulation models. A simple procedure to compute τ, the e-folding time scale of the annular mode autocorrelation function, is presented. This quantity concisely quantifies the strength of low-frequency variability in a model and is easy to compute in practice. The sensitivity of τ to model numerics is then studied for two dry primitive equation models driven with the Held–Suarez forcings: one pseudospectral and the other finite volume. For both models, τ is found to be unrealistically large when the horizontal resolutions are low, such as those that are often used in studies in which long integrations are needed to analyze model variability on low frequencies. More surprising is that it is found that, for the pseudospectral model, τ is particularly sensitive to vertical resolution, especially with a triangular truncation at wavenumber 42 (a very common resolution choice). At sufficiently high resolution, the annular mode autocorrelation time scale τ in both models appears to converge around values of 20–25 days, suggesting the existence of an intrinsic time scale at which the extratropical jet vacillates in the Held and Suarez system. The importance of τ for computing the correct response of a model to climate change is explicitly demonstrated by perturbing the pseudospectral model with simple torques. The amplitude of the model’s response to external forcing increases as τ increases, as suggested by the fluctuation–dissipation theorem.Atmospheric sciences, Meteorology, Applied mathematicsepg2108, sv2122, lmp3Applied Physics and Applied MathematicsArticlesInternal Variability of the Winter Stratosphere. Part II: Time-Dependent Forcing
http://academiccommons.columbia.edu/catalog/ac:166906
Scott, R. K.; Polvani, Lorenzo M.; Waugh, D. W.http://hdl.handle.net/10022/AC:P:22107Mon, 04 Nov 2013 10:47:40 +0000This paper considers the effect of time-dependent lower boundary wave forcing on the internal variability found to appear spontaneously in a stratosphere-only model when the forcing is perfectly steady. While the time-dependent forcing is found to modulate the internal variability, leading in some cases to frequency locking of the upper-stratospheric response to the forcing, the temporal and spatial structure of the variability remains similar to the case when the forcing is time independent. Experiments with a time-periodic modulation of the forcing amplitude indicate that the wave flux through the lower boundary is only partially related to the instantaneous forcing, but is more significantly influenced by the condition of the polar vortex itself. In cases of purely random wave forcing with zero time mean, the stratospheric response is similar to that obtained with steady forcing of magnitude equal to the root-mean-square of the time-varying forcing.Atmospheric sciences, Aeronomy, Applied mathematicslmp3Applied Physics and Applied MathematicsArticlesOn the Wavelength of the Rossby Waves Radiated by Tropical Cyclones
http://academiccommons.columbia.edu/catalog/ac:166903
Krouse, Kyle D.; Sobel, Adam H.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22106Mon, 04 Nov 2013 08:59:14 +0000The authors present a theory for the zonal wavelength of tropical depression–type disturbances, which occur as a result of Rossby wave radiation from a preexisting tropical cyclone (TC). In some cases, such disturbances undergo tropical cyclogenesis, resulting in a pair of tropical cyclones; the theory then predicts the zonal separation distance of such tropical cyclone pairs.
Numerical experiments are presented in which a thermally forced vortex, superimposed on an initial state of rest, is moved at different velocities in a shallow-water model on a sphere. Vortices moving westward generate coherent wave trains to the east or southeast (depending on the amplitude of the vortex), resembling those in observations. The zonal wavelengths of these wave trains in each case are well described by the linear stationary solution in the frame comoving with the vortex. Vortices moving eastward or remaining stationary do not generate such trains, also consistent with linear theory, which admits no stationary solutions in such cases. It is hypothesized that the wavelengths of observed disturbances are set by the properties of the relevant stationary solution. The environmental flow velocity that determines this wavelength is not the translation velocity of the tropical cyclone, but the difference between the steering flow of the radiated Rossby waves and that of the TC. The authors argue that either horizontal or vertical shear in the environment of the TC can generate differences between these steering flows of the necessary magnitude and sign to generate the observed wavelengths.Atmospheric sciences, Applied mathematics, Meteorologykdk8, ahs129, lmp3Applied Physics and Applied Mathematics, Earth and Environmental SciencesArticlesEquatorial Superrotation in Shallow Atmospheres
http://academiccommons.columbia.edu/catalog/ac:166899
Scott, R. K.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22104Fri, 01 Nov 2013 18:00:10 +0000Simple, shallow-water models have been successful in reproducing two key observables in the atmospheres of the giant planets: the formation of robust, and fully turbulent, latitudinal jets and the decrease of the zonal wind amplitude with latitude. However, they have to date consistently failed in reproducing the strong prograde (superrotating) equatorial winds that are often observed on such planets. In this paper we show that shallow water models not only can give rise to superrotating winds, but can do so very robustly, provided that the physical process of large-scale energy dissipation by radiative relaxation is taken into account. When energy is removed by linear friction, equatorial superrotation does not develop; when energy is removed by radiative relaxation, superrotation develops at apparently any deformation radius.Atmospheric sciences, Meteorology, Applied mathematicslmp3Applied Physics and Applied MathematicsArticlesAnnular Mode Time Scales in the Intergovernmental Panel on Climate Change Fourth Assessment Report Models
http://academiccommons.columbia.edu/catalog/ac:166896
Gerber, Edwin P.; Polvani, Lorenzo M.; Ancukiewicz, Damianhttp://hdl.handle.net/10022/AC:P:22103Fri, 01 Nov 2013 17:52:32 +0000The ability of climate models in the Intergovernmental Panel on Climate Change Fourth Assessment Report to capture the temporal structure of the annular modes is evaluated. The vertical structure and annual cycle of the variability is quantified by the e-folding time scale of the annular mode autocorrelation function. Models vaguely capture the qualitative features of the Northern and Southern Annular Modes: Northern Hemisphere time scales are shorter than those of the Southern Hemisphere and peak in boreal winter, while Southern Hemisphere time scales peak in austral spring and summer. Models, however, systematically overestimate the time scales, particularly in the Southern Hemisphere summer, where the multimodel ensemble average is twice that of reanalyses. Fluctuation-dissipation theory suggests that long time scales in models could be associated with increased sensitivity to anthropogenic forcing. Comparison of model pairs with similar forcings but different annular mode time scales provides a hint of a fluctuation-dissipation relationship.Atmospheric sciences, Applied mathematics, Climate changeepg2108, lmp3, da2260Applied Physics and Applied Mathematics, Earth and Environmental Sciences, Engineering and Applied ScienceArticlesThe Effect of Topography on Storm-Track Intensity in a Relatively Simple General Circulation Model
http://academiccommons.columbia.edu/catalog/ac:166878
Son, Seok-Woo; Polvani, Lorenzo M.; Ting, Mingfanghttp://hdl.handle.net/10022/AC:P:22098Fri, 01 Nov 2013 15:08:00 +0000The effect of topography on storm-track intensity is examined with a set of primitive equation model integrations. This effect is found to be crucially dependent on the latitudinal structure of the background flow impinging on the topography. If the background flow consists of a weak double jet, higher topography leads to an intensification of the storm track downstream of the topography, consistent with enhanced baroclinicity in that region. However, if the background flow consists of a strong single jet, topography weakens the storm track, despite the fact that the baroclinicity downstream of the topography is again enhanced.
The different topographic impact results from the different wave packets in the two background flows. For a weak double-jet state, wave packets tend to radiate equatorward and storm-track eddies grow primarily at the expense of local baroclinicity. In contrast, for a strong single-jet state, wave packets persistently propagate in the zonal direction and storm tracks are affected not only by local baroclinicity but also by far-upstream disturbances via downstream development. It is the reduction of the latter by the topography that leads to weaker storm tracks in a strong single-jet state. The implications of these findings for Northern Hemisphere storm tracks are also discussed.Atmospheric sciences, Meteorology, Applied mathematicssws2112, lmp3, mt2204Applied Physics and Applied Mathematics, Earth and Environmental Sciences, Lamont-Doherty Earth Observatory, Ocean and Climate PhysicsArticlesEquatorial Superrotation on Tidally Locked Exoplanets
http://academiccommons.columbia.edu/catalog/ac:166848
Showman, Adam P.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22087Fri, 01 Nov 2013 10:30:50 +0000The increasing richness of exoplanet observations has motivated a variety of three-dimensional (3D) atmospheric circulation models of these planets. Under strongly irradiated conditions, models of tidally locked, short-period planets (both hot Jupiters and terrestrial planets) tend to exhibit a circulation dominated by a fast eastward, or "superrotating," jet stream at the equator. When the radiative and advection timescales are comparable, this phenomenon can cause the hottest regions to be displaced eastward from the substellar point by tens of degrees longitude. Such an offset has been subsequently observed on HD 189733b, supporting the possibility of equatorial jets on short-period exoplanets. Despite its relevance, however, the dynamical mechanisms responsible for generating the equatorial superrotation in such models have not been identified. Here, we show that the equatorial jet results from the interaction of the mean flow with standing Rossby waves induced by the day-night thermal forcing. The strong longitudinal variations in radiative heating—namely intense dayside heating and nightside cooling—trigger the formation of standing, planetary-scale equatorial Rossby and Kelvin waves. The Rossby waves develop phase tilts that pump eastward momentum from high latitudes to the equator, thereby inducing equatorial superrotation. We present an analytic theory demonstrating this mechanism and explore its properties in a hierarchy of one-layer (shallow-water) calculations and fully 3D models. The wave-mean-flow interaction produces an equatorial jet whose latitudinal width is comparable to that of the Rossby waves, namely the equatorial Rossby deformation radius modified by radiative and frictional effects. For conditions typical of synchronously rotating hot Jupiters, this length is comparable to a planetary radius, explaining the broad scale of the equatorial jet obtained in most hot-Jupiter models. Our theory illuminates the dependence of the equatorial jet speed on forcing amplitude, strength of friction, and other parameters, as well as the conditions under which jets can form at all.Atmospheric sciences, Planetology, Applied mathematicslmp3Applied Physics and Applied Mathematics, Lamont-Doherty Earth ObservatoryArticlesEl Niño, La Niña, and Stratospheric Sudden Warmings: A Reevaluation in Light of the Observational Record
http://academiccommons.columbia.edu/catalog/ac:166842
Butler, Amy H.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22085Thu, 31 Oct 2013 17:57:38 +0000Recent studies have suggested that El Niño-Southern Oscillation (ENSO) may have a considerable impact on Northern Hemisphere wintertime stratospheric conditions. Notably, during El Niño the stratosphere is warmer than during ENSO-neutral winters, and the polar vortex is weaker. Opposite-signed anomalies have been reported during La Niña, but are considerably smaller in amplitude than during El Niño. This has led to the perception that El Niño is able to substantially affect stratospheric conditions, but La Niña is of secondary importance. Here we revisit this issue, but focus on the extreme events that couple the troposphere to the stratosphere: major, mid-winter stratospheric sudden warmings (SSWs). We examine 53 years of reanalysis data and find, as expected, that SSWs are nearly twice as frequent during ENSO winters as during non-ENSO winters. Surprisingly, however, we also find that SSWs occur with equal probability during El Niño and La Niña winters. These findings corroborate the impact of ENSO on stratospheric variability, and highlight that both phases of ENSO are important in enhancing stratosphere-troposphere dynamical coupling via an increased frequency of SSWs.Atmospheric sciences, Meteorology, Applied mathematicslmp3Applied Physics and Applied Mathematics, Earth and Environmental Sciences, Lamont-Doherty Earth ObservatoryArticlesUncertainty in Climate Change Projections of the Hadley Circulation: The Role of Internal Variability
http://academiccommons.columbia.edu/catalog/ac:172651
Kang, Sarah M.; Deser, Clara; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22067Thu, 31 Oct 2013 14:16:36 +0000The uncertainty arising from internal climate variability in climate change projections of the Hadley circulation (HC) is presently unknown. In this paper it is quantified by analyzing a 40-member ensemble of integrations of the Community Climate System Model, version 3 (CCSM3), under the Special Report on Emissions Scenarios (SRES) A1B scenario over the period 2000–60. An additional set of 100-yr-long time-slice integrations with the atmospheric component of the same model [Community Atmosphere Model, version 3.0 (CAM3)] is also analyzed.
Focusing on simple metrics of the HC—its strength, width, and height—three key results emerge from the analysis of the CCSM3 ensemble. First, the projected weakening of the HC is almost entirely confined to the Northern Hemisphere, and is stronger in winter than in summer. Second, the projected widening of the HC occurs only in the winter season but in both hemispheres. Third, the projected rise of the tropical tropopause occurs in both hemispheres and in all seasons and is, by far, the most robust of the three metrics.
This paper shows further that uncertainty in future trends of the HC width is largely controlled by extratropical variability, while those of HC strength and height are associated primarily with tropical dynamics. Comparison of the CCSM3 and CAM3 integrations reveals that ocean–atmosphere coupling is the dominant source of uncertainty in future trends of HC strength and height and of the tropical mean meridional circulation in general. Finally, uncertainty in future trends of the hydrological cycle is largely captured by the uncertainty in future trends of the mean meridional circulation.Atmospheric sciences, Meteorology, Applied mathematicslmp3Applied Physics and Applied Mathematics, Earth and Environmental SciencesArticlesThe Antarctic Atmospheric Energy Budget. Part I: Climatology and Intraseasonal-to-Interannual Variability
http://academiccommons.columbia.edu/catalog/ac:172197
Previdi, Michael; Smith, Karen L.; Polvani, Lorenzo M.http://hdl.handle.net/10022/AC:P:22064Thu, 31 Oct 2013 14:02:37 +0000The authors present a new, observationally based estimate of the atmospheric energy budget for the Antarctic polar cap (the region poleward of 70°S). This energy budget is constructed using state-of-the-art reanalysis products from ECMWF [the ECMWF Interim Re-Analysis (ERA-Interim)] and Clouds and the Earth's Radiant Energy System (CERES) top-of-atmosphere (TOA) radiative fluxes for the period 2001–10. The climatological mean Antarctic energy budget is characterized by an approximate balance between the TOA net outgoing radiation and the horizontal convergence of atmospheric energy transport, with the net surface energy flux and atmospheric energy storage generally being small in comparison. Variability in the energy budget on intraseasonal-to-interannual time scales bears a strong signature of the southern annular mode (SAM), with El Niño–Southern Oscillation (ENSO) having a smaller impact. The energy budget framework is shown to be a useful alternative to the SAM for interpreting surface climate variability in the Antarctic region.Atmospheric sciences, Meteorology, Applied mathematicsmp2609, kls2177, lmp3Lamont-Doherty Earth Observatory, Ocean and Climate Physics, Applied Physics and Applied Mathematics, Earth and Environmental SciencesArticlesUnderstanding Hadley Cell Expansion versus Contraction: Insights from Simplified Models and Implications for Recent Observations
http://academiccommons.columbia.edu/catalog/ac:168459
Tandon, Neil F.; Gerber, Edwin P.; Sobel, Adam H.; Polvani, Lorenzo M.Thu, 31 Oct 2013 12:29:22 +0000This study seeks a deeper understanding of the causes of Hadley Cell (HC) expansion, as projected under global warming, and HC contraction, as observed under El Niño. Using an idealized general circulation model, the authors show that a thermal forcing applied to a narrow region around the equator produces “El Niño–like” HC contraction, while a forcing with wider meridional extent produces “global warming–like” HC expansion. These circulation responses are sensitive primarily to the thermal forcing’s meridional structure and are less sensitive to its vertical structure. If the thermal forcing is confined to the midlatitudes, the amount of HC expansion is more than three times that of a forcing of comparable amplitude that is spread over the tropics. This finding may be relevant to recently observed trends of rapid tropical widening.
The shift of the HC edge is explained using a very simple model in which the transformed Eulerian mean (TEM) circulation acts to diffuse heat meridionally. In this context, the HC edge is defined as the downward maximum of residual vertical velocity in the upper troposphere ϖmax *; this corresponds well with the conventional Eulerian definition of the HC edge. In response to a positive thermal forcing, there is anomalous diabatic cooling, and hence anomalous TEM descent, on the poleward flank of the thermal forcing. This causes the HC edge (ϖmax *) to shift toward the descending anomaly, so that a narrow forcing causes HC contraction and a wide forcing causes HC expansion.Atmospheric sciences, Applied mathematics, Climate changenft2104, ahs129, lmp3Applied Physics and Applied Mathematics, Earth and Environmental SciencesArticlesResource Cost Aware Scheduling Problems
http://academiccommons.columbia.edu/catalog/ac:166566
Carrasco, Rodrigohttp://hdl.handle.net/10022/AC:P:21999Thu, 17 Oct 2013 14:31:58 +0000Managing the consumption of non-renewable and/or limited resources has become an important issue in many different settings. In this dissertation we explore the topic of resource cost aware scheduling. Unlike the purely scheduling problems, in the resource cost aware setting we are not only interested in a scheduling performance metric, but also the cost of the resources consumed to achieve a certain performance level. There are several ways in which the cost of non-renewal resources can be added into a scheduling problem. Throughout this dissertation we will focus in the case where the resource consumption cost is added, as part of the objective, to a scheduling performance metric such as weighted completion time and weighted tardiness among others. In our work we make several contributions to the problem of scheduling with non-renewable resources. For the specific setting in which only energy consumption is the important resource, our contributions are the following. We introduce a model that extends the previous energy cost models by allowing more general cost functions that can be job-dependent. We further generalize the problem by allowing arbitrary precedence constraints and release dates. We give approximation algorithms for minimizing an objective that is a combination of a scheduling metric, namely total weighted completion time and total weighted tardiness, and the total energy consumption cost. Our approximation algorithm is based on an interval-and-speed-indexed IP formulation. We solve the linear relaxation of this IP and we use this solution to compute a schedule. We show that these algorithms have small constant approximation ratios. Through experimental analysis we show that the empirical approximation ratios are much better than the theoretical ones and that in fact the solutions are close to optimal. We also show empirically that the algorithm can be used in additional settings not covered by the theoretical results, such as using flow time or an online setting, with good approximation and competitiveness ratios.Industrial engineering, Applied mathematicsIndustrial Engineering and Operations ResearchDissertationsOn Lagrange-Hermite Interpolation
http://academiccommons.columbia.edu/catalog/ac:166460
Traub, Joseph F.http://hdl.handle.net/10022/AC:P:21987Thu, 10 Oct 2013 14:40:22 +0000Mathematics, Applied mathematicsjft2Computer ScienceArticlesScaling in Surface Hydrology: Progress and Challenges
http://academiccommons.columbia.edu/catalog/ac:165839
Gentine, Pierre; Troy, Tara J.; Lintner, Benjamin R.; Findell, Kirsten L.http://hdl.handle.net/10022/AC:P:21826Thu, 26 Sep 2013 12:49:10 +0000This paper presents a review of the challenges in spatial and temporal scales in surface hydrology. Fundamental issues and gaps in our understanding of hydrologic scaling are highlighted and shown to limit predictive skill, with heterogeneities, nonlinearities, and non-local transport processes among the most significant difficulties faced in scaling. The discrepancy between the physical process scale and the measurement scale has played a major role in restricting the development of theories, for example, relating observational scales to scales of climate and weather models. Progress in our knowledge of scaling in hydrology requires systematic determination of critical scales and scale invariance of physical processes. In addition, viewing the surface hydrologic system as composed of interacting dynamical subsystems should facilitate the definition of scales observed in nature. Such an approach would inform the development of careful, resolution-dependent, physical law formulation based on mathematical techniques and physical laws.Hydrologic sciences, Applied mathematicspg2328Earth and Environmental Engineering, Lamont-Doherty Earth ObservatoryArticlesHomogenization of Partial Differential Equations with Random, Large Potential
http://academiccommons.columbia.edu/catalog/ac:165171
Zhang, Ningyaohttp://hdl.handle.net/10022/AC:P:21626Fri, 13 Sep 2013 15:56:38 +0000Partial differential equations with highly oscillatory, random coefficients describe many applications in applied science and engineering such as porous media and composite materials. Homogenization of PDE states that the solution of the initial model converges to the solution to a macro model, which is characterized by the PDE with homogenized coefficients. Particularly, we study PDEs with a large potential, a class of PDEs with a potential properly scaled such that the limiting equation has a non-trivial (non-zero) potential.
This thesis consists of the investigation of three issues. The first issue is the convergence of Schodinger equation to a deterministic homogenized PDE in high dimension. The second issue is the convergence of the same equation to a stochastic PDE in low dimension. The third issue is the convergence of elliptic equation with an imaginary potential.Applied mathematicsnz2164Applied Physics and Applied MathematicsDissertationsIncreasing Diversity: Modeling of Social Capital for Navigating the Science and Health Professions Pipeline
http://academiccommons.columbia.edu/catalog/ac:174347
Rumala, Bernice B.http://hdl.handle.net/10022/AC:P:20860Fri, 28 Jun 2013 09:37:25 +0000Social capital theory states that resources, both actual and prospective, are inherently linked to networks and relationships that can be used as opportunities. Therefore, a basic tenet of social capital theory is that "relationships matter." In the science and health profession pipeline, strong mentoring relationships and collaborative research networks are critical elements in developing an individual's capacity for navigating the pipeline and for success and advancement in these fields. However, underrepresented minorities are often bereft of social capital because they lack proper mentorships and are often not part of "inner" circles for networking. Additionally, social capital can be leveraged to develop organizational capacity that supports diversity. In this dissertation, social capital theory is examined through the lens of three pipeline initiatives targeting pre-high school, high school, undergraduate, and graduate-level populations. The three initiatives (E-matching, achieving Successful Productive Academic Research Careers, and Mentoring in Medicine) were evaluated and the results are presented here as three related but unique manuscripts. The particular forms of social capital examined are knowledge, mentorship, and networks needed to navigate the pipeline for science and health professions careers. All three initiatives had significant impact on increasing social capital via the social capital indicators of increased knowledge, mentorship, networks, information and resources. Study results suggest that it would be useful to replicate these initiatives on a larger scale to build social capital at earlier levels of the pipeline to enhance diversity in the science and health professions. Additionally, study results suggest that the social capital obtained from brief interactions in short duration initiatives is valuable as a factor in assisting students to navigate the pipeline; therefore this should not be underestimated. Lastly, a logic model framework is provided for measuring social capital for navigating the STEM and health professions pipeline.Applied mathematics, Science education, Health sciencesbr2111Science Education, Mathematics, Science, and TechnologyDissertationsZonal flow driven by convection and convection driven by internal heating
http://academiccommons.columbia.edu/catalog/ac:161452
Goluskin, Davidhttp://hdl.handle.net/10022/AC:P:20415Thu, 23 May 2013 10:51:47 +0000In the first part, Rayleigh-Benard convection is studied in a two-dimensional, horizontally periodic domain with free-slip top and bottom boundaries. This configuration encourages mean horizontal flows of zero horizontal wavenumber, which we study as an idealization of zonal flows in tokamaks, planetary atmospheres, and annular cylindrical convection experiments. These systems often satisfy free-slip conditions on at least one boundary and are approximately two-dimensional. Stable steady states with zonal flow are found for Prandtl numbers up to 0.3. Stable and unstable steady states with horizontal periods up to six times the layer height are computed for a Prandtl number of 0.1 and Rayleigh numbers, Ra, up to 2*10^5. Concurrently stable states with and without zonal flow are found where the state without zonal flow convects heat over 10 times faster. Steady zonal flow arises subcritically whenever the horizontal period is not forced to be narrow, contrary to most prior predictions by truncated models. Steady states and their bifurcations are studied in a truncated model that does predict subcriticality. Direct numerical simulations are performed with a horizontal period twice the layer height, Prandtl numbers between 1 and 10, and Ra between 5*10^5 and 2*10^8.. Zonal flow arises subcritically as Ra is raised but is seen in all quasi-steady states at large Ra. The fraction of the total kinetic energy comprised by zonal flow approaches unity as Ra grows. At a Prandtl number of 1, vertical convective heat transport occurs in temporal bursts, nearly vanishing in between, and is non-monotonic in Ra. At Prandtl numbers of 3 and 10, convective transport at no time nearly vanishes, and time-averaged Nusselt numbers scale as Ra^0.077 and Ra^0.19, respectively. Both growth rates are below the range accepted for Rayleigh-Benard convection without zonal flow. In the second part, two-dimensional direct numerical simulations are conducted for convection sustained by uniform internal heating in a horizontal fluid layer. Top and bottom boundary temperatures are fixed and equal. Prandtl numbers range from 0.01 to 100. A control parameter, R, that is similar to the usual Rayleigh number is varied up to 5*10^5 times its critical value at the onset of convection. The asymmetry between upward and downward heat fluxes is non-monotonic in R. In a broad high-R regime, dimensionless mean temperature scales as R^-1/5. We discuss the scaling of mean temperature and heat-flux-asymmetry, which we find to be better diagnostic quantities than the conventionally used top and bottom Nusselt numbers.Applied mathematicsdg2422Applied Physics and Applied Mathematics, AstronomyDissertationsTracer-Independent Approaches to Stratosphere-Troposphere Exchange and Tropospheric Air Mass Composition
http://academiccommons.columbia.edu/catalog/ac:161531
Orbe, Clarahttp://hdl.handle.net/10022/AC:P:20400Wed, 22 May 2013 14:56:18 +0000Two transport processes are examined. The first addresses the interaction between the stratosphere and the troposphere. We perform the first analyses of stratosphere-troposphere exchange using one-way flux distributions; diagnostics are illustrated in both idealized and comprehensive contexts. By partitioning the one-way flux across the thermal tropopause according to stratospheric residence time τ and the regions where air enters and exits the stratosphere, the one-way flux is quantified robustly without being rendered ill-defined by the short-τ eddy-diffusive singularity. Diagnostics are first computed using an idealized circulation model that has topography only in the Northern Hemisphere (NH) and is run under perpetual NH winter conditions; suitable integrations are used to determine the stratospheric mean residence time and the mass fraction of the stratosphere in any given residence-time interval. For the idealized model we find that air exiting the stratosphere in the winter hemisphere has significantly longer mean residence times than air exiting in the summer hemisphere because the winter hemisphere has a deeper circulation and stronger eddy diffusion. The complicated response of mean residence times to increased topography underlines the fact that flux distributions capture the integrated advective-diffusive tropopause-to-tropopause transport, and not merely advection by the residual-mean circulation. Extending one-way flux distributions to non-stationary flow we quantify the seasonal ventilation of the stratosphere using the state-of-the-art GEOSCCM general circulation model subject to fixed present-day climate forcings. From the one-way flux distributions, we determine the mass of the stratosphere that is in transit from the tropical tropopause back to the troposphere, partitioned according to stratospheric residence time and exit location. We find that poleward of 45N, the cross-tropopause flux of air that has resided in the stratosphere three months or less is 34 ± 10 % larger for air that enters the stratosphere in July compared to air that enters in January. During late summer and early fall the stratosphere contains about six times more air of tropical origin that is destined to exit poleward of 45S/N in both hemispheres, after an entry-to-exit residence time of six months or less, than is the case during other times of year. We find that 51 ± 1 % and 39 ± 2 % of the stratospheric air mass of tropical origin, annually averaged and integrated over all residence times, exits poleward of 10N/S in the NH and SH, respectively, with most of the mass exiting downstream of the Pacific and Atlantic storm tracks. The mean residence time of this air is found to be ~ 5.1 years in the NH and ~ 5.7 years in the SH. The second transport process addresses new diagnostics of tropospheric transport. We introduce rigorously defined air masses as a diagnostic of tropospheric transport in the context of an idealized model. The fractional contribution from each air mass partitions air at any given point according to either where it was last in the planetary boundary layer (PBL), or where it was last in contact with the tropopause. The utility of these air-mass fractions in isolating the climate change signature on transport alone is demonstrated for the climate of a dynamical-core circulation model and its response to a specified heating. For an idealized warming that produces dynamical responses that are typical of end-of-century comprehensive model projections, changes in air-mass fractions are order 10% and reveal the model's climate change in tropospheric transport: poleward shifted jets and surface intensified eddy kinetic energy lead to more efficient stirring of air out of the midlatitude boundary layer, suggesting that in the future there may be increased transport of industrial pollutants to the Arctic upper troposphere. Correspondingly, air is less efficiently mixed away from the subtropical boundary layer. The air-mass fraction that had last stratosphere contact at midlatitudes increases all the way to the surface, in part due to increased isentropic eddy transport across the tropopause. A weakened Hadley circulation leads to decreased interhemispheric transport in the model's future climate.Applied mathematics, Atmospheric sciencesco2203Applied Physics and Applied Mathematics, Earth and Environmental SciencesDissertationsEarthquake Surface Slip-Length Data is Fit by Constant Stress Drop and is Useful for Seismic Hazard Analysis
http://academiccommons.columbia.edu/catalog/ac:161283
Shaw, Bruce E.http://hdl.handle.net/10022/AC:P:20361Fri, 17 May 2013 14:16:25 +0000We present a new method to use directly observable surface-slip measurements in seismic hazard estimates.We present measures of scaling-relation fits to slip length data. These fits show sublinear scaling, a slowing in the rate of slip increase for the longest ruptures, so that L scaling—scaling with the length of the rupture—does not hold out to very large aspect ratio events. We find the best fitting for a constant stress drop model, followed next by a square root of length model. The constant stress-drop model, newly introduced here, provides a geometrical explanation for a long-standing puzzle of why slip only begins to saturate at large aspect ratios. The good fit of the constant stress-drop model to the slip-length data lends further support to the observations of constant stress-drop scaling across the whole range of magnitudes of earthquakes, from small to great earthquakes. The good fit of the constant stress-drop model is also reflected by the low variability about the mean, with an average of less than a factor-of-2 variability in stress drop about the mean observed. Converting magnitude-area scaling into implied slip-length scaling, we determine qualitative consistency in the functional forms, but a quantitative difference of, on average, about 30 percent more slip estimated from magnitude area compared with slip length.Geology, Geophysics, Applied mathematicsbes11Lamont-Doherty Earth ObservatoryArticlesOn optimal arbitrage under constraints
http://academiccommons.columbia.edu/catalog/ac:160495
Sadhukhan, Subhankarhttp://hdl.handle.net/10022/AC:P:20076Wed, 01 May 2013 11:07:50 +0000In this thesis, we investigate the existence of relative arbitrage opportunities in a Markovian model of a financial market, which consists of a bond and stocks, whose prices evolve like Itô processes. We consider markets where investors are constrained to choose from among a restricted set of investment strategies. We show that the upper hedging price of (i.e. the minimum amount of wealth needed to superreplicate) a given contingent claim in a constrained market can be expressed as the supremum of the fair price of the given contingent claim under certain unconstrained auxiliary Markovian markets. Under suitable assumptions, we further characterize the upper hedging price as viscosity solution to certain variational inequalities. We, then, use this viscosity solution characterization to study how the imposition of stricter constraints on the market affect the upper hedging price. In particular, if relative arbitrage opportunities exist with respect to a given strategy, we study how stricter constraints can make such arbitrage opportunities disappear.Applied mathematics, Financess3240Statistics, MathematicsDissertationsStatistical inference in two non-standard regression problems
http://academiccommons.columbia.edu/catalog/ac:151460
Seijo, Emilio Franciscohttp://hdl.handle.net/10022/AC:P:14317Wed, 08 Aug 2012 13:43:26 +0000This thesis analyzes two regression models in which their respective least squares estimators have nonstandard asymptotics. It is divided in an introduction and two parts. The introduction motivates the study of nonstandard problems and presents an outline of the contents of the remaining chapters. In part I, the least squares estimator of a multivariate convex regression function is studied in great detail. The main contribution here is a proof of the consistency of the aforementioned estimator in a completely nonparametric setting. Model misspecification, local rates of convergence and multidimensional regression models mixing convexity and componentwise monotonicity constraints will also be considered. Part II deals with change-point regression models and the issues that might arise when applying the bootstrap to these problems. The classical bootstrap is shown to be inconsistent on a simple change-point regression model, and an alternative (smoothed) bootstrap procedure is proposed and proved to be consistent. The superiority of the alternative method is also illustrated through a simulation study. In addition, a version of the continuous mapping theorem specially suited for change-point estimators is proved and used to derive the results concerning the bootstrap.Statistics, Applied mathematics, Mathematicsefs2113StatisticsDissertationsTandem connectionist feature stream extraction for conventional HMM systems
http://academiccommons.columbia.edu/catalog/ac:148941
Hermansky, Hynek; Ellis, Daniel P. W.; Sharma, Sangitahttp://hdl.handle.net/10022/AC:P:13821Tue, 03 Jul 2012 11:27:59 +0000Hidden Markov model speech recognition systems typically use Gaussian mixture models to estimate the distributions of decorrelated acoustic feature vectors that correspond to individual subword units. By contrast, hybrid connectionist-HMM systems use discriminatively-trained neural networks to estimate the probability distribution among subword units given the acoustic observations. In this work we show a large improvement in word recognition performance by combining neural-net discriminative feature processing with Gaussian-mixture distribution modeling. By training the network to generate the subword probability posteriors, then using transformations of these estimates as the base features for a conventionally-trained Gaussian-mixture based system, we achieve relative error rate reductions of 35% or more on the multicondition Aurora noisy continuous digits taskElectrical engineering, Applied mathematicsde171Electrical EngineeringArticlesImproved recognition by combining different features and different systems
http://academiccommons.columbia.edu/catalog/ac:148938
Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13818Tue, 03 Jul 2012 11:23:39 +0000Combining multiple estimators to obtain a more accurate final result is a well-known technique in statistics. In the domain of speech recognition, there are many ways in which this general principle can be applied. We have looked at several ways for combining the information from different feature representations, and used these results in the best-performing system in last year's Aurora evaluation: Our entry combined feature streams after the acoustic classification stage, then used a combination of neural networks and Gaussian mixtures for more accurate modeling. These and other approaches to combination are described and compared, and some more general questions arising from the combination of information streams are considered.Electrical engineering, Applied mathematicsde171Electrical EngineeringArticlesTandem acoustic modeling in large-vocabulary recognition
http://academiccommons.columbia.edu/catalog/ac:148916
Ellis, Daniel P. W.; Singh, Rita; Sivadas, Sunilhttp://hdl.handle.net/10022/AC:P:13796Mon, 02 Jul 2012 17:02:24 +0000In the tandem approach to modeling the acoustic signal, a neural-net preprocessor is first discriminatively trained to estimate posterior probabilities across a phone set. These are then used as feature inputs for a conventional hidden Markov model (HMM) based speech recognizer, which relearns the associations to subword units. We apply the tandem approach to the data provided for the first Speech in Noisy Environments (SPINE1) evaluation conducted by the Naval Research Laboratory (NRL) in August 2000. In our previous experience with the ETSI Aurora noisy digits (a small-vocabulary, high-noise task) the tandem approach achieved error-rate reductions of over 50% relative to the HMM baseline. For SPINE1, a larger task involving more spontaneous speech, we find that, when context-independent models are used, the tandem features continue to result in large reductions in word-error rates relative to those achieved by systems using standard MFC or PLP features. However, these improvements do not carry over to context-dependent models. This may be attributable to several factors which are discussed in the paper.Electrical engineering, Applied mathematicsde171Electrical EngineeringArticlesError visualization for tandem acoustic modeling on the Aurora task
http://academiccommons.columbia.edu/catalog/ac:148893
Reyes-Gomez, Manuel; Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13790Mon, 02 Jul 2012 15:47:14 +0000Tandem acoustic modeling consists of taking the outputs of a neural network discriminantly trained to estimate the phone-class posterior probabilities of speech, and using them as the input features of a conventional distribution-modeling Gaussian mixture model (GMM) speech recognizer, thereby employing two acoustic models in tandem. This structure reduces the error rate on the Aurora 2 noisy English digits task in more than 50% compared to the HTK baseline. Even though there are some reasonable hypothesis to explain this improvement, the origins are still unclear. This paper introduces the use of visualization tools for error analysis of some variations of the tandem system. The error behavior is first analyzed using word-level confusion matrices. Posteriorgrams (displays of the variation in time of per-phone posterior probabilities) provide for further analysis. The results of corroborate our previous hypothesis that the gains from tandem modeling arise from the very different training and modeling schemes of the two acoustic models.Electrical engineering, Applied mathematicsmjr59, de171Electrical EngineeringArticlesSelection, Parameter Estimation, and Discriminative Training of Hidden Markov Models for General Audio Modeling
http://academiccommons.columbia.edu/catalog/ac:148890
Reyes-Gomez, Manuel; Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13789Mon, 02 Jul 2012 15:42:18 +0000Hidden Markov models (HMMs) permit a natural and flexible way to model time-sequential data. The ease of concatenation and time-warping algorithms implementation on HMMs suit them very well for segmentation and content based audio classification applications, as is clear from their extended and successful use on speech recognition applications. Speech has a natural basic unit, the phone, which normally delimits the number of models to one per phone. Moreover, knowledge of the speech structure facilitates the choice of the model parameters. When modeling generic audio, on other hand, the lack of a natural basic unit, and the absence of a clear structure, make the selection and the parameter estimation of an optimal set of HMMs difficult. In this paper we present different approaches to select and estimate the HMM parameters of a set of representative generic audio classes. We compare these approaches in the context of a content- based classification application using the MuscleFish database. The models are first found through frame clustering or by traditional EM techniques under some specific selection criteria, such as the Bayesian information criterion. Further discriminative training of the initial models considerably improve their performance in the content-based classification task, obtaining results comparable with the ones obtained, for the same task, by inherently discriminative classification methods, such as support vector machines, while preserving the intrinsic flexibility of HMMs.Electrical engineering, Applied mathematicsmjr59, de171Electrical EngineeringArticlesAnchor Space for Classification and Similarity Measurement of Music
http://academiccommons.columbia.edu/catalog/ac:148885
Berenzweig, Adam; Ellis, Daniel P. W.; Lawrence, Stevehttp://hdl.handle.net/10022/AC:P:13788Mon, 02 Jul 2012 15:25:32 +0000This paper describes a method of mapping music into a semantic space that can be used for similarity measurement, classification, and music information retrieval. The value along each dimension of this anchor space is computed as the output from a pattern classifier which is trained to measure a particular semantic feature. In anchor space, distributions that represent objects such as artists or songs are modeled with Gaussian mixture models, and several similarity measures are defined by computing approximations to the Kullback-Leibler divergence between distributions. Similarity measures are evaluated against human similarity judgements. The models are also used for artist classification to achieve 62% accuracy on a 25-artist set, and 38% on a 404-artist set (random guessing achieves 0.25%). Finally, we describe a music similarity browsing application that makes use of the fact that anchor space dimensions are meaningful to users.Electrical engineering, Applied mathematicsalb63, de171Electrical EngineeringArticlesMulti-channel Source Separation by Factorial HMMs
http://academiccommons.columbia.edu/catalog/ac:148739
Reyes-Gomez, Manuel; Raj, Bhiksha; Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13733Fri, 29 Jun 2012 15:58:22 +0000We present a new speaker-separation algorithm for separating signals with known statistical characteristics from mixed multi-channel recordings. Speaker separation has conventionally been treated as a problem of blind source separation (BSS). This approach does not utilize any knowledge of the statistical characteristics of the signals to be separated, relying mainly on the independence between the various signals to separate them. We present an algorithm that utilizes detailed statistical information about the signals to be separated, represented in the form of hidden Markov models (HMM). We treat the signal separation problem as one of beamforming, where each signal is extracted using a filter-and-sum array. The filters are estimated to maximize the likelihood of the summed output, measured on the HMM for the desired signal. This is done by iteratively estimating the best state sequence through the HMM from a factorial HMM (FHMM) that is the cross-product of the HMMs for the multiple signals, using the current output of the array, and estimating the filters to maximize the likelihood of that state sequence. Experiments show that the proposed method can cleanly extract a background speaker who is 20 dB below the foreground speaker in a two-speaker mixture, when the HMMs for the signals are constructed from knowledge of the utterance transcriptions.Electrical engineering, Applied mathematicsmjr59, de171Electrical EngineeringArticlesMulti-channel Source Separation by Beamforming Trained with Factorial HMMs
http://academiccommons.columbia.edu/catalog/ac:148729
Reyes-Gomez, Manuel; Raj, Bhiksha; Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13730Fri, 29 Jun 2012 15:31:37 +0000Speaker separation has conventionally been treated as a problem of blind source separation (BSS). This approach does not utilize any knowledge of the statistical characteristics of the signals to be separated, relying mainly on the independence between the various signals to separate them. Maximum-likelihood techniques, on the other hand, utilize knowledge of the a priori probability distributions of the signals from the speakers, in order to effect separation. Previously (Reyes-Gomez, M.J. et al., Proc. ICASSP, 2003), we presented a maximum-likelihood speaker separation technique that utilizes detailed statistical information about the signals to be separated, represented in the form of hidden Markov models (HMMs), to estimate the parameters of a filter-and-sum processor for signal separation. We show that the filters that are estimated for a particular utterance by a speaker generalize well to other utterances by the same speaker, provided the location of the various speakers remains constant. Thus, filters that have been estimated using a "training" utterance of a known transcript can be used to separate all future signals by the speaker from mixtures of speech signals in an unsupervised manner. On the other hand, the filters are ineffective for other speakers, even at the same locations, indicating that they capture the spatio-frequency characteristics of the speaker.Electrical engineering, Applied mathematicsmjr59, de171Electrical EngineeringArticlesMultiband audio modeling for single-channel acoustic source separation
http://academiccommons.columbia.edu/catalog/ac:148684
Reyes-Gomez, Manuel; Ellis, Daniel P. W.; Jojic, Nebojsahttp://hdl.handle.net/10022/AC:P:13719Fri, 29 Jun 2012 11:45:21 +0000Detailed hidden Markov models (HMMs) that capture the constraints implicit in a particular sound can be used to estimate obscured or corrupted portions from partial observations, the situation encountered when trying to identify multiple, overlapping sounds. However, when the complexity and variability of the sounds are high, as in a particular speaker's voice, a detailed model might require several thousand states to cover the full range of different short-term spectra with adequate resolution. To address the tractability problems of such large models, we break the source signals into multiple frequency bands, and build separate but coupled HMMs for each band, requiring many fewer states per model. To prevent non-natural full spectral states and to enforce consistency within and between bands, at any given frame, the state in a particular band is determined by the previous state in that band and the states in the adjacent bands. Coupling the bands in this manner results in a grid like model for the full spectrum. Since exact inference of such a model is intractable, we derive an efficient approximation based on variational methods. Results in source separation of combined signals modeled with this approach outperform the separation obtained by full-band models.Electrical engineering, Applied mathematicsmjr59, de171Electrical EngineeringArticlesLP-TRAP: Linear predictive temporal patterns
http://academiccommons.columbia.edu/catalog/ac:148642
Athineos, Marios; Hermansky, Hynek; Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13711Thu, 28 Jun 2012 15:58:00 +0000Autoregressive modeling is applied for approximating the temporal evolution of spectral density in critical-band-sized subbands of a segment of speech signal. The generalized autocorrelation linear predictive technique allows for a compromise between fitting the peaks and the troughs of the Hilbert envelope of the signal in the sub-band. The cosine transform coefficients of the approximated sub-band envelopes, computed recursively from the all-pole polynomials, are used as inputs to a TRAP-based speech recognition system and are shown to improve recognition accuracy.Electrical engineering, Applied mathematicsde171Electrical EngineeringArticlesLearning Auditory Models of Machine Voices
http://academiccommons.columbia.edu/catalog/ac:148630
Dobson, Kelly; Whitman, Brian; Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13706Thu, 28 Jun 2012 14:27:02 +0000Vocal imitation is often found useful in machine therapy sessions as it creates an emphatic relational bridge between human and machine. The feedback of the machine directly responding to the person's imitation can strengthen the trust of this connection. However, vocal imitation of machines often bear little resemblance to the target due to physiological limitations. In practice, we need a way to detect human vocalization of machine sounds that can generalize to new machines. In this study we learn the relationship between vocal imitation of machine sounds and the target sounds to create a predictive model of vocalization of otherwise humanly impossible sounds. After training on a small set of machines and their imitations, we predict the correct target of a new set of imitations with high accuracy. The model outperforms distance metrics between human and machine sounds on the same task and takes into account auditory perception and constraints in vocal expression.Electrical engineering, Applied mathematicsde171Electrical EngineeringArticlesSong-Level Features and Support Vector Machines for Music Classification
http://academiccommons.columbia.edu/catalog/ac:148626
Mandel, Michael I.; Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13705Thu, 28 Jun 2012 14:22:16 +0000Searching and organizing growing digital music collections requires automatic classification of music. This paper describes a new system, tested on the task of artist identification, that uses support vector machines to classify songs based on features calculated over their entire lengths. Since support vector machines are exemplar-based classifiers, training on and classifying entire songs instead of short-time features makes intuitive sense. On a dataset of 1200 pop songs performed by 18 artists, we show that this classifier outperforms similar classifiers that use only SVMs or song-level features. We also show that the KL divergence between single Gaussians and Mahalanobis distance between MFCC statistics vectors perform comparably when classifiers are trained and tested on separate albums, but KL divergence outperforms Mahalanobis distance when trained and tested on songs from the same albums.Electrical engineering, Applied mathematicsde171Electrical EngineeringArticlesToward Semantic Machine Translation
http://academiccommons.columbia.edu/catalog/ac:148588
Andreas, Jacobhttp://hdl.handle.net/10022/AC:P:13690Thu, 28 Jun 2012 09:15:12 +0000This thesis presents a novel approach to interlingual machine translation using Î»-calculus expressions as an intermediate representation. It investigates and extends existing algorithms which learn a combinatorial category grammar for semantic parsing, and introduces two new algorithms for generation out of logical forms inspired by that semantic parser. The results of a set of new experiments for generation and parsing are described, as well as an evaluation of the performance of a semantic translation system created by joining the semantic parser and generator together. Experimental results demonstrate that under certain conditions, this semantic model achieves better performance than a standard phrase-based statistical MT system in both an automated evaluation of translation output and a manual evaluation of adequacy and fluency.Computer science, Applied mathematics, Artificial intelligencejda2129Computer ScienceUndergraduate thesesEstimating Single-Channel Source Separation Masks: Relevance Vector Machine Classifiers vs. Pitch-Based Masking
http://academiccommons.columbia.edu/catalog/ac:148583
Weiss, Ron J.; Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13689Wed, 27 Jun 2012 16:36:16 +0000Audio sources frequently concentrate much of their energy into a relatively small proportion of the available time-frequency cells in a short-time Fourier transform (STFT). This sparsity makes it possible to separate sources, to some degree, simply by selecting STFT cells dominated by the desired source, setting all others to zero (or to an estimate of the obscured target value), and inverting the STFT to a waveform. The problem of source separation then becomes identifying the cells containing good target information. We treat this as a classification problem, and train a Relevance Vector Machine (a probabilistic relative of the Support Vector Machine) to perform this task. We compare the performance of this classifier both against SVMs (it has similar accuracy but is not as efficient as RVMs), and against a traditional Computational Auditory Scene Analysis (CASA) technique based on a noise-robust pitch tracker, which the RVM outperforms significantly. Differences between the RVM- and pitch-tracker-based mask estimation suggest benefits to be obtained by combining both.Electrical engineering, Applied mathematicsde171Electrical EngineeringArticlesA probability model for interaural phase difference
http://academiccommons.columbia.edu/catalog/ac:148580
Mandel, Michael I.; Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13688Wed, 27 Jun 2012 16:28:26 +0000In this paper, we derive a probability model for interaural phase differences at individual spectrogram points. Such a model can combine observations across arbitrary time and frequency regions in a structured way and does not make any assumptions about the characteristics of the sound sources. In experiments with speech from twenty speakers in simulated reverberant environments, this probabilistic method predicted the correct interaural delay of a signal more accurately than generalized cross-correlation methods.Electrical engineering, Applied mathematicsde171Electrical EngineeringArticlesAn EM Algorithm for Localizing Multiple Sound: Sources in Reverberant Environments
http://academiccommons.columbia.edu/catalog/ac:148573
Mandel, Michael I.; Ellis, Daniel P. W.; Jebara, Tonyhttp://hdl.handle.net/10022/AC:P:13686Wed, 27 Jun 2012 15:58:47 +0000We present a method for localizing and separating sound sources in stereo recordings that is robust to reverberation and does not make any assumptions about the source statistics. The method consists of a probabilistic model of binaural multisource recordings and an expectation maximization algorithm for finding the maximum likelihood parameters of that model. These parameters include distributions over delays and assignments of time-frequency regions to sources. We evaluate this method against two comparable algorithms on simulations of simultaneous speech from two or three sources. Our method outperforms the others in anechoic conditions and performs as well as the better of the two in the presence of reverberation.Electrical engineering, Applied mathematicsde171, tj2008Electrical Engineering, Computer ScienceArticlesEvaluation Distance Measures Between Gaussian Mixture Models of MFCCs
http://academiccommons.columbia.edu/catalog/ac:148548
Jensen, Jesper Hojvang; Ellis, Daniel P. W.; Christensen, Mads G.; Jensen, Soren Holdthttp://hdl.handle.net/10022/AC:P:13678Wed, 27 Jun 2012 13:14:02 +0000In music similarity and in the related task of genre classification, a distance measure between Gaussian mixture models is frequently needed. We present a comparison of the Kullback-Leibler distance, the earth movers distance and the normalized L2 distance for this application. Although the normalized L2 distance was slightly inferior to the Kullback-Leibler distance with respect to classification performance, it has the advantage of obeying the triangle inequality, which allows for efficient searching.Electrical engineering, Applied mathematicsde171Electrical EngineeringArticlesClassifying Music Audio with Timbral and Chroma Features
http://academiccommons.columbia.edu/catalog/ac:148541
Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13676Wed, 27 Jun 2012 12:20:31 +0000Music audio classification has most often been addressed by modeling the statistics of broad spectral features, which, by design, exclude pitch information and reflect mainly instrumentation. We investigate using instead beat-synchronous chroma features, designed to reflect melodic and harmonic content and be invariant to instrumentation. Chroma features are less informative for classes such as artist, but contain information that is almost entirely independent of the spectral features, and hence the two can be profitably combined: Using a simple Gaussian classifier on a 20-way pop music artist identification task, we achieve 54% accuracy with MFCCs, 30% with chroma vectors, and 57% by combining the two. All the data and Matlab code to obtain these results are available.Electrical engineering, Applied mathematicsde171Electrical EngineeringArticlesA Tempo-Insensitive Distance Measure for Cover Song Identification based on Chroma Features
http://academiccommons.columbia.edu/catalog/ac:148516
Jensen, Jesper Hojvang; Christensen, Mads G.; Ellis, Daniel P. W.; Jensen, Soren Holdthttp://hdl.handle.net/10022/AC:P:13669Wed, 27 Jun 2012 11:29:53 +0000We present a distance measure between audio files designed to identify cover songs, which are new renditions of previously recorded songs. For each song we compute the chromagram, remove phase information and apply exponentially distributed bands in order to obtain a feature matrix that compactly describes a song and is insensitive to changes in instrumentation, tempo and time shifts. As distance between two songs, we use the Frobenius norm of the difference between their feature matrices normalized to unit norm. When computing the distance, we take possible transpositions into account. In a test collection of 80 songs with two versions of each, 38% of the covers were identified. The system was also evaluated on an independent, international evaluation where it despite having much lower complexity performed on par with the winner of last year.Electrical engineering, Applied mathematicsde171Electrical EngineeringArticlesMultiple-Instance Learning For Music Information Retrieval
http://academiccommons.columbia.edu/catalog/ac:148502
Mandel, Michael I.; Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13664Wed, 27 Jun 2012 10:48:19 +0000Multiple-instance learning algorithms train classifiers from lightly supervised data, i.e. labeled collections of items, rather than labeled items. We compare the multiple-instance learners mi-SVM and MILES on the task of classifying 10- second song clips. These classifiers are trained on tags at the track, album, and artist levels, or granularities, that have been derived from tags at the clip granularity, allowing us to test the effectiveness of the learners at recovering the clip labeling in the training set and predicting the clip labeling for a held-out test set. We find that mi-SVM is better than a control at the recovery task on training clips, with an average classification accuracy as high as 87% over 43 tags; on test clips, it is comparable to the control with an average classification accuracy of up to 68%. MILES performed adequately on the recovery task, but poorly on the test clips.Electrical engineering, Applied mathematicsde171Electrical EngineeringArticlesA variational EM algorithm for learning eigenvoice parameters in mixed signals
http://academiccommons.columbia.edu/catalog/ac:148483
Weiss, Ron J.; Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13661Tue, 26 Jun 2012 16:44:14 +0000We derive an efficient learning algorithm for model-based source separation for use on single channel speech mixtures where the precise source characteristics are not known a priori. The sources are modeled using factor-analyzed hidden Markov models (HMM) where source specific characteristics are captured by an "eigenvoice" speaker subspace model. The proposed algorithm is able to learn adaptation parameters for two speech sources when only a mixture of signals is observed. We evaluate the algorithm on the 2006 speech separation challenge data set and show that it is significantly faster than our earlier system at a small cost in terms of performance.Electrical engineering, Applied mathematicsde171Electrical EngineeringArticlesShort-term audio-visual atoms for generic video concept classification
http://academiccommons.columbia.edu/catalog/ac:148465
Jiang, Wei; Cotton, Courtenay Valentine; Chang, Shih-Fu; Ellis, Daniel P. W.; Loui, Alexander C.http://hdl.handle.net/10022/AC:P:13657Tue, 26 Jun 2012 15:26:05 +0000We investigate the challenging issue of joint audio-visual analysis of generic videos targeting at semantic concept detection. We propose to extract a novel representation, the Short-term Audio-Visual Atom (S-AVA), for improved concept detection. An S-AVA is defined as a short-term region track associated with regional visual features and background audio features. An effective algorithm, named Short-Term Region tracking with joint Point Tracking and Region Segmentation (STR-PTRS), is developed to extract S-AVAs from generic videos under challenging conditions such as uneven lighting, clutter, occlusions, and complicated motions of both objects and camera. Discriminative audio-visual codebooks are constructed on top of S-AVAs using Multiple Instance Learning. Codebook-based features are generated for semantic concept detection. We extensively evaluate our algorithm over Kodak's consumer benchmark video set from real users. Experimental results confirm significant performance improvements - over 120% MAP gain compared to alternative approaches using static region segmentation without temporal tracking. The joint audio-visual features also outperform visual features alone by an average of 8.5% (in terms of AP) over 21 concepts, with many concepts achieving more than 20%.Electrical engineering, Applied mathematicscvc2106, sc250, de171Electrical Engineering, Computer ScienceArticlesThe Ideal Interaural Parameter Mask: A Bound on Binaural Separation Systems
http://academiccommons.columbia.edu/catalog/ac:148459
Mandel, Michael I.; Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13656Tue, 26 Jun 2012 14:18:52 +0000We introduce the ideal interaural parameter mask as an upper bound on the performance of mask-based source separation algorithms that are based on the differences between signals from two microphones or ears. With two additions to our Model-based EM source separation and localization system, its performance approaches that of the IIPM upper bound to within 0.9 dB. These additions battle the effects of reverberation by absorbing reverberant energy and by forcing the ILD estimate to be larger than it might otherwise be. An oracle reliability measure was also added, in the hope that estimating parameters from more reliable regions of the spectrogram would improve separation, but it was not consistently useful.Electrical engineering, Applied mathematicsde171Electrical EngineeringArticlesImproving MIDI-audio alignment with acoustic features
http://academiccommons.columbia.edu/catalog/ac:148456
Devaney, Johanna; Mandel, Michael I.; Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13655Tue, 26 Jun 2012 14:13:59 +0000This paper describes a technique to improve the accuracy of dynamic time warping-based MIDI-audio alignment. The technique implements a hidden Markov model that uses aperiodicity and power estimates from the signal as observations and the results of a dynamic time warping alignment as a prior. In addition to improving the overall alignment, this technique also identifies the transient and steady state sections of the note. This information is important for describing various aspects of a musical performance, including both pitch and rhythm.Electrical engineering, Applied mathematicsde171Electrical EngineeringArticlesMulti-Voice Polyphonic Music Transcription Using Eigeninstruments
http://academiccommons.columbia.edu/catalog/ac:148452
Grindlay, Graham C.; Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13654Tue, 26 Jun 2012 14:06:54 +0000We present a model-based approach to separating and transcribing single-channel, multi-instrument polyphonic music in a semi-blind fashion. Our system extends the non-negative matrix factorization (NMF) algorithm to incorporate constraints on the basis vectors of the solution. In the context of music transcription, this allows us to encode prior knowledge about the space of possible instrument models as a parametric subspace we term "eigeninstruments". We evaluate our algorithm on several synthetic (MIDI) recordings containing different instrument mixtures. Averaged over both sources, we achieved a frame-level accuracy of over 68% on an excerpt of Pachelbel's Canon arranged for doublebass and piano and 72% on a mixture of overlapping melodies played by flute and violin.Electrical engineering, Applied mathematicsde171Electrical EngineeringArticlesGuided harmonic sinusoid estimation in a multi-pitch environment
http://academiccommons.columbia.edu/catalog/ac:148449
Smit, Christine E.; Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13653Tue, 26 Jun 2012 14:00:32 +0000We describe an algorithm to accurately estimate the fundamental frequency of harmonic sinusoids in a mixed voice recording environment using an aligned electronic score as a guide. Taking the pitch tracking results on individual voices prior to mixing as ground truth, we are able estimate the pitch of individual voices in a 4-part piece to within 50 cents of the correct pitch more than 90% of the time.Electrical engineering, Applied mathematicsces2130, de171Electrical EngineeringArticlesFinding similar acoustic events using matching pursuit and locality-sensitive hashing
http://academiccommons.columbia.edu/catalog/ac:148446
Cotton, Courtenay Valentine; Ellis, Daniel P. W.http://hdl.handle.net/10022/AC:P:13652Tue, 26 Jun 2012 13:30:12 +0000There are many applications for the ability to find repetitions of perceptually similar sound events in generic audio recordings. We explore the use of matching pursuit (MP) derived features to identify repeated patterns that characterize distinct acoustic events. We use locality-sensitive hashing (LSH) to efficiently search for similar items. We describe a method for detecting repetitions of events, and demonstrate performance on real data.Electrical engineering, Applied mathematicscvc2106, de171Electrical EngineeringArticlesStructured Prediction Models for Chord Transcription of Music Audio
http://academiccommons.columbia.edu/catalog/ac:148442
Weller, Adrian Vivian; Ellis, Daniel P. W.; Jebara, Tonyhttp://hdl.handle.net/10022/AC:P:13651Tue, 26 Jun 2012 12:52:26 +0000Chord sequences are a compact and useful description of music, representing each beat or measure in terms of a likely distribution over individual notes without specifying the notes exactly. Transcribing music audio into chord sequences is essential for harmonic analysis, and would be an important component in content-based retrieval and indexing, but accuracy rates remain fairly low. In this paper, the existing 2008 LabROSA Supervised Chord Recognition System is modified by using different machine learning methods for decoding structural information, thereby achieving significantly superior results. Specifically, the hidden Markov model is replaced by a large margin structured prediction approach (SVMstruct) using an enlarged feature space. Performance is significantly improved by incorporating features from future (but not past) frames. The benefit of SVMstruct increases with the size of the training set, as might be expected when comparing discriminative and generative models. Without yet exploring non-linear kernels, these improvements lead to state-of-the-art performance in chord transcription. The techniques could prove useful in other sequential learning tasks which currently employ HMMs.Electrical engineering, Applied mathematicsaw2506, de171, tj2008Electrical Engineering, Computer ScienceArticles