Literatūra

Hu, Zhiqiang, Lee, Roy Ka-Wei, Aggarwal, Charu C., Zhang, Aston (2022) Text style transfer: A review and experimental evaluation. SIGKDD Explor. Newsl..

Abadi, Martin, Barham, Paul, Chen, Jianmin, Chen, Zhifeng, Davis, Andy, Dean, Jeffrey, Devin, Matthieu, Ghemawat, Sanjay, Irving, Geoffrey, Isard, Michael, et al. (2016) TensorFlow: A system for large-scale machine learning. 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16).

Abdel-Hamid, Ossama, Mohamed, Abdel-Rahman, Jiang, Hui, Deng, Li, Penn, Gerald, Yu, Dong (2014) Convolutional neural networks for speech recognition. IEEE/ACM Transactions on Audio, Speech, and Language Processing.

Ahmed, Amr, Aly, Moahmed, Gonzalez, Joseph, Narayanamurthy, Shravan, Smola, Alexander J (2012) Scalable inference in latent variable models. Proceedings of the Fifth ACM International Conference on Web Search and Data Mining.

Aji, Srinivas M, McEliece, Robert J (2000) The generalized distributive law. IEEE Transactions on Information Theory.

T. Akiba, S. Sano, T. Yanase, T. Ohta, M. Koyama (2019) Optuna: A next-generation hyperparameter optimization framework. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining.

Alayrac, Jean-Baptiste, Donahue, Jeff, Luc, Pauline, Miech, Antoine, Barr, Iain, Hasson, Yana, Lenc, Karel, Mensch, Arthur, Millican, Katie, Reynolds, Malcolm, et al. (2022) Flamingo: a visual language model for few-shot learning. ArXiv:2204.14198.

Alsallakh, Bilal, Kokhlikyan, Narine, Miglani, Vivek, Yuan, Jun, Reblitz-Richardson, Orion (2020) Mind the PAD – CNNs can develop blind spots. ArXiv:2010.02178.

Anil, Rohan, Gupta, Vineet, Koren, Tomer, Regan, Kevin, Singer, Yoram (2020) Scalable second-order optimization for deep learning. ArXiv:2002.09018.

Anil, Rohan, Dai, Andrew M, Firat, Orhan, Johnson, Melvin, Lepikhin, Dmitry, Passos, Alexandre, Shakeri, Siamak, Taropa, Emanuel, Bailey, Paige, Chen, Zhifeng, et al. (2023) PaLM 2 Technical Report. ArXiv:2305.10403.

Aronszajn, Nachman (1950) Theory of reproducing kernels. Transactions of the American Mathematical Society.

Ba, Jimmy Lei, Kiros, Jamie Ryan, Hinton, Geoffrey E (2016) Layer normalization. ArXiv:1607.06450.

Ba, Jimmy Lei, Kiros, Jamie Ryan, Hinton, Geoffrey E (2016) Layer normalization. ArXiv:1607.06450.

Baevski, Alexei, Auli, Michael (2018) Adaptive input representations for neural language modeling. International Conference on Learning Representations.

Bahdanau, Dzmitry, Cho, Kyunghyun, Bengio, Yoshua (2014) Neural machine translation by jointly learning to align and translate. ArXiv:1409.0473.

Bai, Yuntao, Kadavath, Saurav, Kundu, Sandipan, Askell, Amanda, Kernion, Jackson, Jones, Andy, Chen, Anna, Goldie, Anna, Mirhoseini, Azalia, McKinnon, Cameron, et al. (2022) Constitutional AI: Harmlessness from AI feedback. ArXiv:2212.08073.

R. Baptista, M. Poloczek (2018) Bayesian optimization of combinatorial structures. Proceedings of the 35th International Conference on Machine Learning.

R. Bardenet, M. Brendel, B. Kegl, M. Sebag (2013) Collaborative hyperparameter tuning. Proceedings of the 30th International Conference on Machine Learning (ICML'13).

Bartlett, Peter L, Montanari, Andrea, Rakhlin, Alexander (2021) Deep learning: a statistical viewpoint. ArXiv:2103.09177.

Bay, Herbert, Tuytelaars, Tinne, Van Gool, Luc (2006) SURF: Speeded up robust features. European Conference on Computer Vision.

R. Bellman (1966) Dynamic programming. Science.

Richard Bellman Dynamic Programming. Dover Publications.

Richard Bellman (1952) On the Theory of Dynamic Programming. Proceedings of the National Academy of Sciences.

Richard Bellman (1957) A Markovian Decision Process. Journal of Mathematics and Mechanics.

Beltagy, Iz, Peters, Matthew E, Cohan, Arman (2020) Longformer: The long-document transformer. ArXiv:2004.05150.

Bengio, Yoshua, Ducharme, Rejean, Vincent, Pascal, Jauvin, Christian (2003) A neural probabilistic language model. Journal of Machine Learning Research.

Bengio, Yoshua, Simard, Patrice, Frasconi, Paolo (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks.

Bergstra, James, Breuleux, Olivier, Bastien, Frederic, Lamblin, Pascal, Pascanu, Razvan, Desjardins, Guillaume, Turian, Joseph, Warde-Farley, David, Bengio, Yoshua (2010) Theano: A CPU and GPU math compiler in Python. Proc. 9th Python in Science Conference.

Bergstra, James, Bardenet, Remi, Bengio, Yoshua, Kegl, Balazs (2011) Algorithms for hyper-parameter optimization. Advances in Neural Information Processing Systems.

Beutel, Alex, Murray, Kenton, Faloutsos, Christos, Smola, Alexander J (2014) CoBaFi: collaborative Bayesian filtering. Proceedings of the 23rd International Conference on World Wide Web.

Bishop, Chris M (1995) Training with noise is equivalent to Tikhonov regularization. Neural Computation.

Bishop, Christopher M (2006) Pattern Recognition and Machine Learning. Springer.

Black, Fischer, Scholes, Myron (1973) The pricing of options and corporate liabilities. Journal of Political Economy.

Bodla, Navaneeth, Singh, Bharat, Chellappa, Rama, Davis, Larry S (2017) Soft-NMS-improving object detection with one line of code. Proceedings of the IEEE International Conference on Computer Vision.

Bojanowski, Piotr, Grave, Edouard, Joulin, Armand, Mikolov, Tomas (2017) Enriching word vectors with subword information. Transactions of the Association for Computational Linguistics.

Bollobas, B (1999) Linear Analysis. Cambridge University Press.

Bommasani, Rishi, Hudson, Drew A, Adeli, Ehsan, Altman, Russ, Arora, Simran, von Arx, Sydney, Bernstein, Michael S, Bohg, Jeannette, Bosselut, Antoine, Brunskill, Emma, et al. (2021) On the opportunities and risks of foundation models. ArXiv:2108.07258.

Bottou, Leon (2010) Large-scale machine learning with stochastic gradient descent. Proceedings of COMPSTAT'2010.

Bottou, Leon, Le Cun, Yann (1988) SN: A simulator for connectionist models. Proceedings of NeuroNimes 88.

Boucheron, Stephane, Bousquet, Olivier, Lugosi, Gabor (2005) Theory of classification: A survey of some recent advances. ESAIM: Probability and Statistics.

Bowman, Samuel R, Angeli, Gabor, Potts, Christopher, Manning, Christopher D (2015) A large annotated corpus for learning natural language inference. ArXiv:1508.05326.

Stephen Boyd, Lieven Vandenberghe Convex Optimization. Cambridge University Press.

Bradley, Ralph Allan, Terry, Milton E (1952) Rank analysis of incomplete block designs: I. The method of paired comparisons. Biometrika.

Brown, Peter F, Cocke, John, Della Pietra, Stephen A, Della Pietra, Vincent J, Jelinek, Frederick, Mercer, Robert L, Roossin, Paul (1988) A statistical approach to language translation. COLING Budapest 1988 Volume 1: International Conference on Computational Linguistics.

Brown, Peter F, Cocke, John, Della Pietra, Stephen A, Della Pietra, Vincent J, Jelinek, Frederick, Lafferty, John, Mercer, Robert L, Roossin, Paul S (1990) A statistical approach to machine translation. Computational Linguistics.

Brown, Noam, Sandholm, Tuomas (2017) Libratus: The superhuman AI for no-limit poker.. IJCAI.

Brown, Tom, Mann, Benjamin, Ryder, Nick, Subbiah, Melanie, Kaplan, Jared D, Dhariwal, Prafulla, Neelakantan, Arvind, Shyam, Pranav, Sastry, Girish, Askell, Amanda, et al. (2020) Language models are few-shot learners. Advances in Neural Information Processing Systems.

Buslaev, Alexander, Iglovikov, Vladimir I, Khvedchenya, Eugene, Parinov, Alex, Druzhinin, Mikhail, Kalinin, Alexandr A (2020) Albumentations: Fast and flexible image augmentations. Information.

Ramon y Cajal, Santiago,, Azoulay, L. (1894) Les Nouvelles Idees sur la Structure du Systeme Nerveux chez l'Homme et chez les Vertebres. Paris, C. Reinwald & Cie.

Campbell, Murray, Hoane Jr, A Joseph, Hsu, Feng-hsiung (2002) Deep blue. Artificial Intelligence.

Canny, John (1987) A computational approach to edge detection. Readings in Computer Vision.

F.~P. Cantelli Sulla probabilita come limita della frequenza. Rend.\ Accad.\ Lincei.

Cer, Daniel, Diab, Mona, Agirre, Eneko, Lopez-Gazpio, Inigo, Specia, Lucia (2017) SemEval-2017 Task 1: Semantic textual similarity multilingual and crosslingual focused evaluation. Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017).

Chan, William, Jaitly, Navdeep, Le, Quoc V, Vinyals, Oriol (2015) Listen, attend and spell. ArXiv:1508.01211.

Chen, Tianqi, Li, Mu, Li, Yutian, Lin, Min, Wang, Naiyan, Wang, Minjie, Xiao, Tianjun, Xu, Bing, Zhang, Chiyuan, Zhang, Zheng (2015) MXNET: A flexible and efficient machine learning library for heterogeneous distributed systems. ArXiv:1512.01274.

Chen, Mark, Radford, Alec, Child, Rewon, Wu, Jeffrey, Jun, Heewoo, Luan, David, Sutskever, Ilya (2020) Generative pretraining from pixels. International Conference on machine learning.

Chen, Lili, Lu, Kevin, Rajeswaran, Aravind, Lee, Kimin, Grover, Aditya, Laskin, Misha, Abbeel, Pieter, Srinivas, Aravind, Mordatch, Igor (2021) Decision transformer: Reinforcement learning via sequence modeling. Advances in Neural Information Processing Systems.

Cheng, Jianpeng, Dong, Li, Lapata, Mirella (2016) Long short-term memory-networks for machine reading. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing.

Chetlur, Sharan, Woolley, Cliff, Vandermersch, Philippe, Cohen, Jonathan, Tran, John, Catanzaro, Bryan, Shelhamer, Evan (2014) cuDNN: Efficient primitives for deep learning. ArXiv:1410.0759.

Child, Rewon, Gray, Scott, Radford, Alec, Sutskever, Ilya (2019) Generating long sequences with sparse transformers. ArXiv:1904.10509.

Cho, Kyunghyun, Van Merrienboer, Bart, Bahdanau, Dzmitry, Bengio, Yoshua (2014) On the properties of neural machine translation: Encoder–decoder approaches. ArXiv:1409.1259.

Cho, Kyunghyun, Van Merrienboer, Bart, Gulcehre, Caglar, Bahdanau, Dzmitry, Bougares, Fethi, Schwenk, Holger, Bengio, Yoshua (2014) Learning phrase representations using RNN encoder–decoder for statistical machine translation. ArXiv:1406.1078.

Chowdhery, Aakanksha, Narang, Sharan, Devlin, Jacob, Bosma, Maarten, Mishra, Gaurav, Roberts, Adam, Barham, Paul, Chung, Hyung Won, Sutton, Charles, Gehrmann, Sebastian, et al. (2022) PaLM: Scaling language modeling with pathways. ArXiv:2204.02311.

Chowdhury, Gobinda G (2010) Introduction to Modern Information Retrieval. Facet Publishing.

Chung, Junyoung, Gulcehre, Caglar, Cho, KyungHyun, Bengio, Yoshua (2014) Empirical evaluation of gated recurrent neural networks on sequence modeling. ArXiv:1412.3555.

Clark, Kevin, Luong, Minh-Thang, Le, Quoc V, Manning, Christopher D (2020) ELECTRA: Pre-training text encoders as discriminators rather than generators. International Conference on Learning Representations.

Collobert, Ronan, Weston, Jason, Bottou, Leon, Karlen, Michael, Kavukcuoglu, Koray, Kuksa, Pavel (2011) Natural language processing (almost) from scratch. Journal of Machine Learning Research.

Cordonnier, Jean-Baptiste, Loukas, Andreas, Jaggi, Martin (2020) On the relationship between self-attention and convolutional layers. International Conference on Learning Representations.

Corfield, David, Scholkopf, Bernhard, Vapnik, Vladimir (2009) Falsificationism and statistical learning theory: Comparing the Popper and Vapnik–Chervonenkis dimensions. Journal for General Philosophy of Science.

Cover, T, Thomas, JM (1999) Elements of Information Theory. John Wiley & Sons.

Cramer, H (1946) Mathematical Methods of Statistics.. Princeton University Press.

Csiszar, Imre (2008) Axiomatic characterizations of information measures. Entropy.

Cybenko, George (1989) Approximation by superpositions of a sigmoidal function. Mathematics of Control, Signals and Systems.

Dalal, Navneet, Triggs, Bill (2005) Histograms of oriented gradients for human detection. 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

De Cock, Dean (2011) Ames, Iowa: Alternative to the Boston housing data as an end of semester regression project. Journal of Statistics Education.

De Valois, Russell L, Albrecht, Duane G, Thorell, Lisa G (1982) Spatial frequency selectivity of cells in macaque visual cortex. Vision Research.

Dean, Jeffrey, Corrado, Greg S, Monga, Rajat, Chen, Kai, Devin, Matthieu, Le, Quoc V, Mao, Mark Z, Ranzato, Marc'Aurelio, Senior, Andrew, Tucker, Paul, et al. (2012) Large scale distributed deep networks. Proceedings of the 25th International Conference on Neural Information Processing Systems, Volume 1.

DeCandia, Giuseppe, Hastorun, Deniz, Jampani, Madan, Kakulapati, Gunavardhan, Lakshman, Avinash, Pilchin, Alex, Sivasubramanian, Swaminathan, Vosshall, Peter, Vogels, Werner (2007) Dynamo: Amazon's highly available key-value store. ACM SIGOPS Operating Systems Review.

Deng, Jia, Dong, Wei, Socher, Richard, Li, Li-Jia, Li, Kai, Fei-Fei, Li (2009) Imagenet: A large-scale hierarchical image database. 2009 IEEE Conference on Computer Vision and Pattern Recognition.

Der Kiureghian, Armen, Ditlevsen, Ove (2009) Aleatory or epistemic? Does it matter?. Structural Safety.

Devlin, Jacob, Chang, Ming-Wei, Lee, Kenton, Toutanova, Kristina (2018) BERT: Pre-training of deep bidirectional transformers for language understanding. ArXiv:1810.04805.

Dinh, Laurent, Krueger, David, Bengio, Yoshua (2014) NICE: Non-linear independent components estimation. ArXiv:1410.8516.

Dinh, Laurent, Sohl-Dickstein, Jascha, Bengio, Samy (2017) Density estimation using Real NVP. International Conference on Learning Representations.

Doersch, Carl, Gupta, Abhinav, Efros, Alexei A (2015) Unsupervised visual representation learning by context prediction. Proceedings of the IEEE International Conference on Computer Vision.

Dosovitskiy, Alexey, Beyer, Lucas, Kolesnikov, Alexander, Weissenborn, Dirk, Zhai, Xiaohua, Unterthiner, Thomas, Dehghani, Mostafa, Minderer, Matthias, Heigold, Georg, Gelly, Sylvain, et al. (2021) An image is worth 16 x 16 words: Transformers for image recognition at scale. International Conference on Learning Representations.

Dosovitskiy, Alexey, Beyer, Lucas, Kolesnikov, Alexander, Weissenborn, Dirk, Zhai, Xiaohua, Unterthiner, Thomas, Dehghani, Mostafa, Minderer, Matthias, Heigold, Georg, Gelly, Sylvain, et al. (2021) An image is worth $16\times 16$ words: Transformers for image recognition at scale. International Conference on Learning Representations.

Doucet, Arnaud, De Freitas, Nando, Gordon, Neil (2001) An introduction to sequential Monte Carlo methods. Sequential Monte Carlo Methods in Practice.

Du, Nan, Huang, Yanping, Dai, Andrew M, Tong, Simon, Lepikhin, Dmitry, Xu, Yuanzhong, Krikun, Maxim, Zhou, Yanqi, Yu, Adams Wei, Firat, Orhan, et al. (2021) GLaM: Efficient scaling of language models with mixture-of-experts. ArXiv:2112.06905.

Duchi, John, Hazan, Elad, Singer, Yoram (2011) Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research.

Dumoulin, Vincent, Visin, Francesco (2016) A guide to convolution arithmetic for deep learning. ArXiv:1603.07285.

Dwivedi, Vijay Prakash, Bresson, Xavier (2020) A generalization of transformer networks to graphs. ArXiv:2012.09699.

Dwork, Cynthia, Feldman, Vitaly, Hardt, Moritz, Pitassi, Toniann, Reingold, Omer, Roth, Aaron Leon (2015) Preserving statistical validity in adaptive data analysis. Proceedings of the 47th Annual ACM Symposium on Theory of Computing.

Edelman, Benjamin, Ostrovsky, Michael, Schwarz, Michael (2007) Internet advertising and the generalized second-price auction: Selling billions of dollars worth of keywords. American Economic Review.

Elman, Jeffrey L (1990) Finding structure in time. Cognitive Science.

T. Elsken, J. H. Metzen, F. Hutter (2018) Neural architecture search: A sSurvey. ArXiv:1808.05377 [stat.ML].

Fechner, Gustav Theodor (1860) Elemente der Psychophysik. Breitkopf u. Hartel.

Fedus, William, Zoph, Barret, Shazeer, Noam (2022) Switch transformers: scaling to trillion parameter models with simple and efficient sparsity. Journal of Machine Learning Research.

Fernando, Randima (2004) GPU Gems: Programming Techniques, Tips, and Tricks for Real-Time Graphics. Addison-Wesley.

M. Feurer, B. Letham, F. Hutter, E. Bakshy (2022) Practical transfer learning for Bayesian optimization. ArXiv:1802.02219 [stat.ML].

M. Feurer, F. Hutter (2018) Hyperparameter ptimization. Automatic Machine Learning: Methods, Systems, Challenges.

Field, David J (1987) Relations between the statistics of natural images and the response properties of cortical cells. JOSA A.

Fisher, R A (1925) Statistical Methods for Research Workers.. Oliver & Boyd.

Flammarion, Nicolas, Bach, Francis (2015) From averaging to acceleration, there is only a step-size. Conference on Learning Theory.

Forrester, Alexander IJ, Sobester, Andras, Keane, Andy J (2007) Multi-fidelity optimization via surrogate modelling. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

L. Franceschi, M. Donini, P. Frasconi, M. Pontil (2017) Forward and Reverse Gradient-Based Hyperparameter Optimization. Proceedings of the 34th International Conference on Machine Learning (ICML'17).

Frankle, Jonathan, Carbin, Michael (2018) The lottery ticket hypothesis: Finding sparse, trainable neural networks. ArXiv:1803.03635.

Frazier, Peter I (2018) A tutorial on Bayesian optimization. ArXiv:1807.02811.

Freund, Yoav, Schapire, Robert E (1996) Experiments with a new boosting algorithm. Proceedings of the International Conference on Machine Learning.

Friedman, Jerome H (1997) On bias, variance, 0/1-loss, and the curse-of-dimensionality. Data Mining and Knowledge Discovery.

Friedman, Jerome H (1987) Exploratory projection pursuit. Journal of the American Statistical Association.

Frostig, Roy, Johnson, Matthew James, Leary, Chris (2018) Compiling machine learning programs via high-level tracing. Proceedings of Systems for Machine Learning.

Fukushima, Kunihiko (1982) Neocognitron: A self-organizing neural network model for a mechanism of visual pattern recognition. Competition and Cooperation in Neural Nets.

Gardner, Jacob, Pleiss, Geoff, Weinberger, Kilian Q, Bindel, David, Wilson, Andrew G (2018) GPyTorch: Blackbox matrix–matrix Gaussian process inference with GPU acceleration. Advances in Neural Information Processing Systems.

Garg, Saurabh, Balakrishnan, Sivaraman, Kolter, Zico, Lipton, Zachary (2021) RATT: Leveraging unlabeled data to guarantee generalization. International Conference on Machine Learning.

Gatys, Leon A, Ecker, Alexander S, Bethge, Matthias (2016) Image style transfer using convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

Gauss, Carl Friedrich (1809) Theoria motus corporum coelestum. Werke.

Gibbs, Josiah Willard (1902) Elementary Principles of Statistical Mhanics. Scribner's.

Ginibre, Jean (1965) Statistical ensembles of complex, quaternion, and real matrices. Journal of Mathematical Physics.

Girshick, Ross (2015) Fast R-CNN. Proceedings of the IEEE International Conference on Computer Vision.

Girshick, Ross, Donahue, Jeff, Darrell, Trevor, Malik, Jitendra (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

V.~I. Glivenko Sulla determinazione empirica delle leggi di probabilita. Giornale dell'Istituta Italiano degli Attuari.

Glorot, Xavier, Bengio, Yoshua (2010) Understanding the difficulty of training deep feedforward neural networks. Proceedings of the 13th International Conference on Artificial Intelligence and Statistics.

Goh, Gabriel (2017) Why momentum really works. Distill.

Goldberg, David, Nichols, David, Oki, Brian M, Terry, Douglas (1992) Using collaborative filtering to weave an information tapestry. Communications of the ACM.

Golub, Gene H, Van Loan, Charles F (1996) Matrix Computations. Johns Hopkins University Press.

Ian Goodfellow, Yoshua Bengio, Aaron Courville (2016) Deep Learning. MIT Press.

Goodfellow, Ian, Pouget-Abadie, Jean, Mirza, Mehdi, Xu, Bing, Warde-Farley, David, Ozair, Sherjil, Courville, Aaron, Bengio, Yoshua (2014) Generative adversarial nets. Advances in Neural Information Processing Systems.

Gotmare, Akhilesh, Keskar, Nitish Shirish, Xiong, Caiming, Socher, Richard (2018) A closer look at deep learning heuristics: Learning rate restarts, warmup and distillation. ArXiv:1810.13243.

Goyal, Ankit, Bochkovskiy, Alexey, Deng, Jia, Koltun, Vladlen (2021) Non-deep networks. ArXiv:2110.07641.

Graham, Benjamin (2014) Fractional max-pooling. ArXiv:1412.6071.

Graves, Alex (2013) Generating sequences with recurrent neural networks. ArXiv:1308.0850.

Graves, Alex, Schmidhuber, Jurgen (2005) Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Networks.

Graves, Alex, Liwicki, Marcus, Fernandez, Santiago, Bertolami, Roman, Bunke, Horst, Schmidhuber, Jurgen (2008) A novel connectionist system for unconstrained handwriting recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence.

Griewank, Andreas (1989) On automatic differentiation. Mathematical Programming: Recent Developments and Applications.

Gulati, Anmol, Qin, James, Chiu, Chung-Cheng, Parmar, Niki, Zhang, Yu, Yu, Jiahui, Han, Wei, Wang, Shibo, Zhang, Zhengdong, Wu, Yonghui, et al. (2020) Conformer: Convolution-augmented Transformer for Speech Recognition. Proc. Interspeech 2020.

Gunawardana, Asela, Shani, Guy (2015) Evaluating recommender systems. Recommender Systems Handbook.

Guo, Huifeng, Tang, Ruiming, Ye, Yunming, Li, Zhenguo, He, Xiuqiang (2017) DeepFM: a factorization-machine based neural network for CTR prediction. Proceedings of the 26th International Joint Conference on Artificial Intelligence.

Guyon, Isabelle, Gunn, Steve, Nikravesh, Masoud, Zadeh, Lofti A (2008) Feature Extraction: Foundations and Applications. Springer.

Hadjis, Stefan, Zhang, Ce, Mitliagkas, Ioannis, Iter, Dan, Re, Christopher (2016) Omnivore: An optimizer for multi-device deep learning on CPUs and GPUs. ArXiv:1606.04487.

Hartley, Richard, Zisserman, Andrew (2000) Multiple View Geometry in Computer Vision. Cambridge University Press.

Hartley, Richard I, Kahl, Fredrik (2009) Global optimization through rotation space search. International Journal of Computer Vision.

Hazan, Elad, Rakhlin, Alexander, Bartlett, Peter L (2008) Adaptive online gradient descent. Advances in Neural Information Processing Systems.

He, Xiangnan, Chua, Tat-Seng (2017) Neural factorization machines for sparse predictive analytics. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval.

He, Kaiming, Gkioxari, Georgia, Dollar, Piotr, Girshick, Ross (2017) Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision.

He, Xiangnan, Liao, Lizi, Zhang, Hanwang, Nie, Liqiang, Hu, Xia, Chua, Tat-Seng (2017) Neural collaborative filtering. Proceedings of the 26th International Conference on World Wide Web.

He, Kaiming, Zhang, Xiangyu, Ren, Shaoqing, Sun, Jian (2015) Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification. Proceedings of the IEEE International Conference on Computer Vision.

He, Kaiming, Zhang, Xiangyu, Ren, Shaoqing, Sun, Jian (2016) Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

He, Kaiming, Zhang, Xiangyu, Ren, Shaoqing, Sun, Jian (2016) Identity mappings in deep residual networks. European Conference on Computer Vision.

He, Kaiming, Chen, Xinlei, Xie, Saining, Li, Yanghao, Dollar, Piotr, Girshick, Ross (2022) Masked autoencoders are scalable vision learners. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

Hebb, Donald Olding (1949) The Organization of Behavior. Wiley.

Hendrycks, Dan, Gimpel, Kevin (2016) Gaussian error linear units (GELUs). ArXiv:1606.08415.

Henighan, Tom, Kaplan, Jared, Katz, Mor, Chen, Mark, Hesse, Christopher, Jackson, Jacob, Jun, Heewoo, Brown, Tom B, Dhariwal, Prafulla, Gray, Scott, et al. (2020) Scaling laws for autoregressive generative modeling. ArXiv:2010.14701.

Hennessy, John L, Patterson, David A (2011) Computer Architecture: A Quantitative Approach. Elsevier.

Herlocker, Jonathan L, Konstan, Joseph A, Borchers, Al, Riedl, John (1999) An algorithmic framework for performing collaborative filtering. 22nd Annual International ACM Conference on Research and Development in Information Retrieval, SIGIR 1999.

Hernandez, Danny, Kaplan, Jared, Henighan, Tom, McCandlish, Sam (2021) Scaling laws for transfer. ArXiv:2102.01293.

Hidasi, Balazs, Karatzoglou, Alexandros, Baltrunas, Linas, Tikk, Domonkos (2015) Session-based recommendations with recurrent neural networks. ArXiv:1511.06939.

Ho, Jonathan, Jain, Ajay, Abbeel, Pieter (2020) Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems.

Hochreiter, Sepp, Bengio, Yoshua, Frasconi, Paolo, Schmidhuber, Jurgen (2001) Gradient flow in recurrent nets: the difficulty of learning long-term dependencies. A Field Guide to Dynamical Recurrent Neural Networks.

Hochreiter, Sepp, Schmidhuber, Jurgen (1997) Long short-term memory. Neural Computation.

Hoffmann, Jordan, Borgeaud, Sebastian, Mensch, Arthur, Buchatskaya, Elena, Cai, Trevor, Rutherford, Eliza, Casas, Diego de Las, Hendricks, Lisa Anne, Welbl, Johannes, Clark, Aidan, et al. (2022) Training compute-optimal large language models. ArXiv:2203.15556.

Howard, Andrew, Sandler, Mark, Chu, Grace, Chen, Liang-Chieh, Chen, Bo, Tan, Mingxing, Wang, Weijun, Zhu, Yukun, Pang, Ruoming, Vasudevan, Vijay, Le, Quoc V., Adam, Hartwig (2019) Searching for MobileNetV3. Proceedings of the IEEE/CVF International Conference on Computer Vision.

Hoyer, Patrik O, Janzing, Dominik, Mooij, Joris M, Peters, Jonas, Scholkopf, Bernhard (2009) Nonlinear causal discovery with additive noise models. Advances in Neural Information Processing Systems.

Hu, Yifan, Koren, Yehuda, Volinsky, Chris (2008) Collaborative filtering for implicit feedback datasets. 2008 8th IEEE International Conference on Data Mining.

Hu, Jie, Shen, Li, Sun, Gang (2018) Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

Huang, Gao, Liu, Zhuang, Van Der Maaten, Laurens, Weinberger, Kilian Q (2017) Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

Huang, Zhiheng, Xu, Wei, Yu, Kai (2015) Bidirectional LSTM–CRF models for sequence tagging. ArXiv:1508.01991.

Huang, Cheng-Zhi Anna, Vaswani, Ashish, Uszkoreit, Jakob, Simon, Ian, Hawthorne, Curtis, Shazeer, Noam, Dai, Andrew M, Hoffman, Matthew D, Dinculescu, Monica, Eck, Douglas (2018) Music transformer: generating music with long-term structure. International Conference on Learning Representations.

Hubel, David H, Wiesel, Torsten N (1959) Receptive fields of single neurones in the cat's striate cortex. Journal of Physiology.

Hubel, David H, Wiesel, Torsten N (1962) Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. Journal of Physiology.

Hubel, David H, Wiesel, Torsten N (1968) Receptive fields and functional architecture of monkey striate cortex. Journal of Physiology.

(2019) Automated Machine Learning: Methods, Systems, Challenges. Springer.

F. Hutter, H. Hoos, K. Leyton-Brown (2011) Sequential Model-Based Optimization for General Algorithm Configuration. Proceedings of the Fifth International Conference on Learning and Intelligent Optimization (LION'11).

Ioffe, Sergey (2017) Batch renormalization: Towards reducing minibatch dependence in batch-normalized models. Advances in Neural Information Processing Systems.

Ioffe, Sergey, Szegedy, Christian (2015) Batch normalization: Accelerating deep network training by reducing internal covariate shift. ArXiv:1502.03167.

Izmailov, Pavel, Podoprikhin, Dmitrii, Garipov, Timur, Vetrov, Dmitry, Wilson, Andrew Gordon (2018) Averaging weights leads to wider optima and better generalization. ArXiv:1803.05407.

Jacot, Arthur, Gabriel, Franck, Hongler, Clement (2018) Neural tangent kernel: Convergence and generalization in neural networks. Advances in Neural Information Processing Systems.

Jaeger, Herbert (2002) Tutorial on training recurrent neural networks, covering BPPT, RTRL, EKF and the ``echo state network'' approach. GMD-Forschungszentrum Informationstechnik Bonn.

James, William (2007) The Principles of Psychology. Cosimo, Inc..

K. Jamieson, A. Talwalkar (2016) Non-stochastic best arm identification and hyperparameter optimization. Proceedings of the 17th International Conference on Artificial Intelligence and Statistics.

R. Jenatton, C. Archambeau, J. González, M. Seeger (2017) Bayesian optimization with tree-structured dependencies. Proceedings of the 34th International Conference on Machine Learning (ICML'17).

Jia, Yangqing, Shelhamer, Evan, Donahue, Jeff, Karayev, Sergey, Long, Jonathan, Girshick, Ross, Guadarrama, Sergio, Darrell, Trevor (2014) Caffe: Convolutional architecture for fast feature embedding. Proceedings of the 22nd ACM International Conference on Multimedia.

Jia, Xianyan, Song, Shutao, He, Wei, Wang, Yangzihao, Rong, Haidong, Zhou, Feihu, Xie, Liqiang, Guo, Zhenyu, Yang, Yuanzhou, Yu, Liwei, et al. (2018) Highly scalable deep learning training system with mixed-precision: Training ImageNet in four minutes. ArXiv:1807.11205.

Joshi, Mandar, Chen, Danqi, Liu, Yinhan, Weld, Daniel S, Zettlemoyer, Luke, Levy, Omer (2020) SpanBERT: Improving pre-training by representing and predicting spans. Transactions of the Association for Computational Linguistics.

Jouppi, Norman P, Young, Cliff, Patil, Nishant, Patterson, David, Agrawal, Gaurav, Bajwa, Raminder, Bates, Sarah, Bhatia, Suresh, Boden, Nan, Borchers, Al, et al. (2017) In-datacenter performance analysis of a tensor processing unit. 2017 ACM/IEEE 44th Annual International Symposium on Computer Architecture (ISCA).

Kalchbrenner, Nal, Grefenstette, Edward, Blunsom, Phil (2014) A convolutional neural network for modelling sentences. ArXiv:1404.2188.

Kalman, Barry L, Kwasny, Stan C (1992) Why tanh: choosing a sigmoidal function. Proceedings of the International Joint Conference on Neural Networks (IJCNN).

Kaplan, Jared, McCandlish, Sam, Henighan, Tom, Brown, Tom B, Chess, Benjamin, Child, Rewon, Gray, Scott, Radford, Alec, Wu, Jeffrey, Amodei, Dario (2020) Scaling laws for neural language models. ArXiv:2001.08361.

Z. Karnin, T. Koren, O. Somekh (2013) Almost optimal exploration in multi-armed bandits. Proceedings of the 30th International Conference on Machine Learning (ICML'13).

Karras, Tero, Aila, Timo, Laine, Samuli, Lehtinen, Jaakko (2017) Progressive growing of GANs for improved quality, stability, and variation. ArXiv:1710.10196.

Kawaguchi, Kenji, Kaelbling, Leslie Pack, Bengio, Yoshua (2017) Generalization in deep learning. ArXiv:1710.05468.

Kim, Yoon (2014) Convolutional neural networks for sentence classification. ArXiv:1408.5882.

Kim, Jaeyoung, El-Khamy, Mostafa, Lee, Jungwon (2017) Residual LSTM: Design of a deep recurrent architecture for distant speech recognition. ArXiv:1701.03360.

G.~S.~Kimeldorf, G.~Wahba Some results on Tchebycheffian spline functions. J. Math. Anal. Appl..

Kingma, Diederik P, Ba, Jimmy (2014) Adam: A method for stochastic optimization. ArXiv:1412.6980.

Kingma, Diederik P., Welling, Max Auto-encoding variational Bayes. International Conference on Learning Representations (ICLR).

Kipf, Thomas N, Welling, Max (2016) Semi-supervised classification with graph convolutional networks. ArXiv:1609.02907.

Kojima, Takeshi, Gu, Shixiang Shane, Reid, Machel, Matsuo, Yutaka, Iwasawa, Yusuke (2022) Large Language Models are Zero-Shot Reasoners. arxiv.org/abs/2205.11916.

Koller, Daphne, Friedman, Nir (2009) Probabilistic Graphical Models: Principles and Techniques. MIT Press.

Kolmogorov, Andrey (1933) Sulla determinazione empirica di una legge di distribuzione. Inst. Ital. Attuari, Giorn..

Kolter, Zico (2008) Linear algebra review and reference. Available online: http://cs229.stanford.edu/section/cs229-linalg.pdf.

Koren, Yehuda (2009) Collaborative filtering with temporal dynamics. Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.

Koren, Yehuda, Bell, Robert, Volinsky, Chris (2009) Matrix factorization techniques for recommender systems. Computer.

Krizhevsky, Alex, Sutskever, Ilya, Hinton, Geoffrey E (2012) ImageNet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems.

Krogh, Anders, Hertz, John A (1992) A simple weight decay can improve generalization. Advances in Neural Information Processing Systems.

Kung, Sun Yuan (1988) VLSI Array Processors. Prentice Hall.

Kuzovkin, Ilya, Vicente, Raul, Petton, Mathilde, Lachaux, Jean-Philippe, Baciu, Monica, Kahane, Philippe, Rheims, Sylvain, Vidal, Juan R, Aru, Jaan (2018) Activations of deep convolutional neural networks are aligned with gamma band activity of human visual cortex. Communications Biology.

Lan, Zhenzhong, Chen, Mingda, Goodman, Sebastian, Gimpel, Kevin, Sharma, Piyush, Soricut, Radu (2019) ALBERT: A lite BERT for self-supervised learning of language representations. ArXiv:1909.11942.

Lavin, Andrew, Gray, Scott (2016) Fast algorithms for convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

Le, Quoc V (2013) Building high-level features using large scale unsupervised learning. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing.

LeCun, Yann, Bengio, Yoshua, et al. (1995) Convolutional networks for images, speech, and time series. The Handbook of Brain Theory and Neural Networks.

LeCun, Yann, Boser, Bernhard, Denker, John S, Henderson, Donnie, Howard, Richard E, Hubbard, Wayne, Jackel, Lawrence D (1989) Backpropagation applied to handwritten zip code recognition. Neural Computation.

LeCun, Yann, Bottou, Leon, Bengio, Yoshua, Haffner, Patrick (1998) Gradient-based learning applied to document recognition. Proceedings of the IEEE.

LeCun, Yann, Bottou, Leon, Orr, G, Muller, Klaus-Robert (1998) Efficient backprop. Neural Networks: Tricks of the Trade.

LeCun, Yann, Jackel, LD, Bottou, Leon, Brunot, A, Cortes, Corinna, Denker, John, Drucker, Harris, Guyon, Isabelle, Muller, UA, Sackinger, Eduard, et al. (1995) Comparison of learning algorithms for handwritten digit recognition. International Conference on Artificial Neural Networks.

Legendre, Adrien Marie (1805) Memoire sur les Operations Trigonometriques: dont les Resultats Dependent de la Figure de la Terre. F. Didot.

Lewis, Mike, Liu, Yinhan, Goyal, Naman, Ghazvininejad, Marjan, Mohamed, Abdelrahman, Levy, Omer, Stoyanov, Ves, Zettlemoyer, Luke (2019) BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. ArXiv:1910.13461.

Lewkowycz, Aitor, Andreassen, Anders, Dohan, David, Dyer, Ethan, Michalewski, Henryk, Ramasesh, Vinay, Slone, Ambrose, Anil, Cem, Schlag, Imanol, Gutman-Solo, Theo, et al. (2022) Solving quantitative reasoning problems with language models. ArXiv:2206.14858.

L. Li, K. Jamieson, A. Rostamizadeh, K. Gonina, M. Hardt, B. Recht, A. Talwalkar (2018) Massively parallel hyperparameter tuning. ArXiv:1810.05934.

L. Li, K. Jamieson, G. DeSalvo, A. Rostamizadeh, A. Talwalkar (2017) Hyperband: Bandit-based configuration evaluation for hyperparameter optimization. International Conference on Learning Representations (ICLR'17).

Li, Mu (2017) Scaling Distributed Machine Learning with System and Algorithm Co-design.

Li, Mu, Andersen, David G, Park, Jun Woo, Smola, Alexander J, Ahmed, Amr, Josifovski, Vanja, Long, James, Shekita, Eugene J, Su, Bor-Yiing (2014) Scaling distributed machine learning with the parameter server. 11th Symposium on Operating Systems Design and Implementation (OSDI 14).

Li, Mu, Zhang, Tong, Chen, Yuqiang, Smola, Alexander J (2014) Efficient mini-batch training for stochastic optimization. Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.

R. Liaw, E. Liang, R. Nishihara, P. Moritz, J. Gonzalez, I. Stoica (2018) Tune: A research platform for distributed model selection and training. ArXiv:1807.05118.

Lin, Min, Chen, Qiang, Yan, Shuicheng (2013) Network in network. ArXiv:1312.4400.

Lin, Zhouhan, Feng, Minwei, Santos, Cicero Nogueira dos, Yu, Mo, Xiang, Bing, Zhou, Bowen, Bengio, Yoshua (2017) A structured self-attentive sentence embedding. ArXiv:1703.03130.

Lin, Tsung-Yi, Goyal, Priya, Girshick, Ross, He, Kaiming, Dollar, Piotr (2017) Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision.

Lin, Yuanqing, Lv, F, Zhu, S, Yang, M, Cour, T, Yu, K, Cao, L, Li, Z, Tsai, MH, Zhou, X, others (2010) ImageNet classification: fast descriptor coding and large-scale SVM training. Large Scale Visual Recognition Challenge.

Lipton, Zachary C, Berkowitz, John, Elkan, Charles (2015) A critical review of recurrent neural networks for sequence learning. ArXiv:1506.00019.

Lipton, Zachary C, Kale, David C, Elkan, Charles, Wetzel, Randall (2016) Learning to diagnose with LSTM recurrent neural networks. International Conference on Learning Representations (ICLR).

Lipton, Zachary C, Steinhardt, Jacob (2018) Troubling trends in machine learning scholarship. Communications of the ACM.

Liu, Wei, Anguelov, Dragomir, Erhan, Dumitru, Szegedy, Christian, Reed, Scott, Fu, Cheng-Yang, Berg, Alexander C (2016) SSD: Single shot multibox detector. European Conference on Computer Vision.

Liu, Dong C, Nocedal, Jorge (1989) On the limited memory BFGS method for large scale optimization. Mathematical Programming.

Liu, Yinhan, Ott, Myle, Goyal, Naman, Du, Jingfei, Joshi, Mandar, Chen, Danqi, Levy, Omer, Lewis, Mike, Zettlemoyer, Luke, Stoyanov, Veselin (2019) RoBERTa: A robustly optimized BERT pretraining approach. ArXiv:1907.11692.

Liu, Hanxiao, Simonyan, Karen, Yang, Yiming (2018) DARTS: Differentiable architecture search. ArXiv:1806.09055.

Liu, Ze, Lin, Yutong, Cao, Yue, Hu, Han, Wei, Yixuan, Zhang, Zheng, Lin, Stephen, Guo, Baining (2021) Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision.

Liu, Zhuang, Mao, Hanzi, Wu, Chao-Yuan, Feichtenhofer, Christoph, Darrell, Trevor, Xie, Saining (2022) A ConvNet for the 2020s. ArXiv:2201.03545.

Long, Jonathan, Shelhamer, Evan, Darrell, Trevor (2015) Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

Loshchilov, Ilya, Hutter, Frank (2016) SGDR: Stochastic gradient descent with warm restarts. ArXiv:1608.03983.

Lowe, David G (2004) Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision.

Luo, Ping, Wang, Xinjiang, Shao, Wenqi, Peng, Zhanglin (2018) Towards understanding regularization in batch normalization. ArXiv:1809.00846.

Maas, Andrew L, Daly, Raymond E, Pham, Peter T, Huang, Dan, Ng, Andrew Y, Potts, Christopher (2011) Learning word vectors for sentiment analysis. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Volume 1.

Mack, Yue-Pok, Silverman, Bernard W (1982) Weak and strong uniform consistency of kernel regression estimates. Zeitschrift fur Wahrscheinlichkeitstheorie und verwandte Gebiete.

MacKay, David JC (2003) Information Theory, Inference and Learning Algorithms. Cambridge University Press.

D. Maclaurin, D. Duvenaud, R. Adams (2015) Gradient-based Hyperparameter Optimization through Reversible Learning. Proceedings of the 32nd International Conference on Machine Learning (ICML'15).

O.~L.~Mangasarian Linear and nonlinear separation of patterns by linear programming. Oper. Res..

Mangram, Myles E (2013) A simplified perspective of the Markowitz portfolio theory. Global Journal of Business Research.

Matthews, Alexander G de G, Rowland, Mark, Hron, Jiri, Turner, Richard E, Ghahramani, Zoubin (2018) Gaussian process behaviour in wide deep neural networks. ArXiv:1804.11271.

McCann, Bryan, Bradbury, James, Xiong, Caiming, Socher, Richard (2017) Learned in translation: Contextualized word vectors. Advances in Neural Information Processing Systems.

McCulloch, Warren S, Pitts, Walter (1943) A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biophysics.

McMahan, H Brendan, Holt, Gary, Sculley, David, Young, Michael, Ebner, Dietmar, Grady, Julian, Nie, Lan, Phillips, Todd, Davydov, Eugene, Golovin, Daniel, et al. (2013) Ad click prediction: a view from the trenches. Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.

Mead, Carver (1980) Introduction to VLSI systems. IEE Proceedings I-Solid-State and Electron Devices.

Merity, Stephen, Xiong, Caiming, Bradbury, James, Socher, Richard (2016) Pointer sentinel mixture models. ArXiv:1609.07843.

C.~A.~Micchelli Algebraic aspects of interpolation. Proceedings of Symposia in Applied Mathematics.

Micchelli, Charles A (1984) Interpolation of scattered data: distance matrices and conditionally positive definite functions. Approximation Theory and Spline Functions.

Mikolov, Tomas, Chen, Kai, Corrado, Greg, Dean, Jeffrey (2013) Efficient estimation of word representations in vector space. ArXiv:1301.3781.

Mikolov, Tomas, Sutskever, Ilya, Chen, Kai, Corrado, Greg S, Dean, Jeff (2013) Distributed representations of words and phrases and their compositionality. Advances in Neural Information Processing Systems.

Miller, George A (1995) WordNet: a lexical database for English. Communications of the ACM.

Mirhoseini, Azalia, Pham, Hieu, Le, Quoc V, Steiner, Benoit, Larsen, Rasmus, Zhou, Yuefeng, Kumar, Naveen, Norouzi, Mohammad, Bengio, Samy, Dean, Jeff (2017) Device placement optimization with reinforcement learning. Proceedings of the 34th International Conference on Machine Learning.

Mnih, Volodymyr, Heess, Nicolas, Graves, Alex, others (2014) Recurrent models of visual attention. Advances in Neural Information Processing Systems.

Ouyang, Long, Wu, Jeff, Jiang, Xu, Almeida, Diogo, Wainwright, Carroll L, Mishkin, Pamela, Zhang, Chong, Agarwal, Sandhini, Slama, Katarina, Ray, Alex, et al. (2022) Training language models to follow instructions with human feedback. ArXiv:2203.02155.

Mnih, Volodymyr, Kavukcuoglu, Koray, Silver, David, Rusu, Andrei A, Veness, Joel, Bellemare, Marc G, Graves, Alex, Riedmiller, Martin, Fidjeland, Andreas K, Ostrovski, Georg, et al. (2015) Human-level control through deep reinforcement learning. Nature.

Moon, Taesup, Smola, Alex, Chang, Yi, Zheng, Zhaohui (2010) Intervalrank: isotonic regression with listwise and pairwise constraints. Proceedings of the 3rd ACM International Conference on Web Search and Data Mining.

Morey, Richard D, Hoekstra, Rink, Rouder, Jeffrey N, Lee, Michael D, Wagenmakers, Eric-Jan (2016) The fallacy of placing confidence in confidence intervals. Psychonomic Bulletin & Review.

Morozov, Vladimir Alekseevich (1984) Methods for Solving Incorrectly Posed Problems. Springer.

Murata, Noboru, Yoshizawa, Shuji, Amari, Shun-ichi (1994) Network information criterion – determining the number of hidden units for an artificial neural network model. IEEE Transactions on Neural Networks.

Nadaraya, Elizbar A (1964) On estimating regression. Theory of Probability & its Applications.

Nagarajan, Vaishnavh, Kolter, J Zico (2019) Uniform convergence may be unable to explain generalization in deep learning. ArXiv:1902.04742.

Nair, Vinod, Hinton, Geoffrey E (2010) Rectified linear units improve restricted Boltzmann machines. ICML.

Nakkiran, Preetum, Kaplun, Gal, Bansal, Yamini, Yang, Tristan, Barak, Boaz, Sutskever, Ilya (2021) Deep double descent: Where bigger models and more data hurt. Journal of Statistical Mechanics: Theory and Experiment.

Naor, Moni, Reingold, Omer (1999) On the construction of pseudorandom permutations: Luby–Rackoff revisited. Journal of Cryptology.

Neal, Radford M (1996) Bayesian Learning for Neural Networks. Springer.

Nesterov, Yu (2018) Lectures on Convex Optimization. Springer.

Nesterov, Yu, Vial, J-Ph (2000) Confidence level solutions for stochastic programming. Automatica.

Neyman, Jerzy (1937) Outline of a theory of statistical estimation based on the classical theory of probability. Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences.

Norelli, Antonio, Fumero, Marco, Maiorca, Valentino, Moschella, Luca, Rodola, Emanuele, Locatello, Francesco (2022) ASIF: Coupled data turns unimodal models to multimodal without training. ArXiv:2210.01738.

Novak, Roman, Xiao, Lechao, Lee, Jaehoon, Bahri, Yasaman, Yang, Greg, Hron, Jiri, Abolafia, Daniel A, Pennington, Jeffrey, Sohl-Dickstein, Jascha (2018) Bayesian deep convolutional networks with many channels are Gaussian processes. ArXiv:1810.05148.

A.~B.~J.~Novikoff On convergence proofs on perceptrons. Proceedings of the Symposium on the Mathematical Theory of Automata.

Olshausen, Bruno A, Field, David J (1996) Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature.

Ong, Cheng Soon, Smola, Alexander, Williamson, Robert (2005) Learning the kernel with hyperkernels. Journal of Machine Learning Research.

OpenAI (2023) GPT-4 Technical Report. ArXiv:2303.08774.

Papineni, Kishore, Roukos, Salim, Ward, Todd, Zhu, Wei-Jing (2002) BLEU: a method for automatic evaluation of machine translation. Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics.

Parikh, Ankur P, Tackstrom, Oscar, Das, Dipanjan, Uszkoreit, Jakob (2016) A decomposable attention model for natural language inference. ArXiv:1606.01933.

Park, Taesung, Liu, Ming-Yu, Wang, Ting-Chun, Zhu, Jun-Yan (2019) Semantic image synthesis with spatially-adaptive normalization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

Parzen, Emanuel (1957) On consistent estimates of the spectrum of a stationary time series. Annals of Mathematical Statistics.

Paszke, Adam, Gross, Sam, Massa, Francisco, Lerer, Adam, Bradbury, James, Chanan, Gregory, Killeen, Trevor, Lin, Zeming, Gimelshein, Natalia, Antiga, Luca, et al. (2019) PyTorch: An imperative style, high-performance deep learning library. Advances in Neural Information Processing Systems.

Paulus, Romain, Xiong, Caiming, Socher, Richard (2017) A deep reinforced model for abstractive summarization. ArXiv:1705.04304.

Penedo, Guilherme, Malartic, Quentin, Hesslow, Daniel, Cojocaru, Ruxandra, Cappelli, Alessandro, Alobeidli, Hamza, Pannier, Baptiste, Almazrouei, Ebtesam, Launay, Julien (2023) The RefinedWeb dataset for Falcon LLM: outperforming curated corpora with web data, and web data only. ArXiv:2306.01116.

Pennington, Jeffrey, Schoenholz, Samuel, Ganguli, Surya (2017) Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice. Advances in Neural Information Processing Systems.

Pennington, Jeffrey, Socher, Richard, Manning, Christopher (2014) GloVe: Global vectors for word representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP).

Peters, Matthew, Ammar, Waleed, Bhagavatula, Chandra, Power, Russell (2017) Semi-supervised sequence tagging with bidirectional language models. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Volume 1.

Peters, Jonas, Janzing, Dominik, Scholkopf, Bernhard (2017) Elements of Causal Inference: Foundations and Learning Algorithms. MIT Press.

Peters, Matthew, Neumann, Mark, Iyyer, Mohit, Gardner, Matt, Clark, Christopher, Lee, Kenton, Zettlemoyer, Luke (2018) Deep contextualized word representations. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1.

Petersen, Kaare Brandt, Pedersen, Michael Syskind (2008) The Matrix Cookbook. Technical University of Denmark.

Pleiss, Geoff, Chen, Danlu, Huang, Gao, Li, Tongcheng, Van Der Maaten, Laurens, Weinberger, Kilian Q (2017) Memory-efficient implementation of densenets. ArXiv:1707.06990.

Polyak, Boris T (1964) Some methods of speeding up the convergence of iteration methods. USSR Computational Mathematics and Mathematical Physics.

Popper, Karl (2005) The Logic of Scientific Discovery. Routledge.

Prakash, Aaditya, Hasan, Sadid A, Lee, Kathy, Datla, Vivek, Qadir, Ashequl, Liu, Joey, Farri, Oladimeji (2016) Neural paraphrase generation with stacked residual LSTM networks. ArXiv:1610.03098.

Prechelt, Lutz (1998) Early stopping – but when?. Neural Networks: Tricks of the Trade.

Qin, Chengwei, Zhang, Aston, Zhang, Zhuosheng, Chen, Jiaao, Yasunaga, Michihiro, Yang, Diyi (2023) Is ChatGPT a general-purpose natural language processing task solver?. ArXiv:2302.06476.

Quadrana, Massimo, Cremonesi, Paolo, Jannach, Dietmar (2018) Sequence-aware recommender systems. ACM Computing Surveys.

Quinlan, J Ross (1993) C4.5: Programs for Machine Learning. Elsevier.

Rabiner, Lawrence, Juang, Biing-Hwang (1993) Fundamentals of Speech Recognition. Prentice-Hall..

Radford, Alec, Metz, Luke, Chintala, Soumith (2015) Unsupervised representation learning with deep convolutional generative adversarial networks. ArXiv:1511.06434.

Radford, Alec, Narasimhan, Karthik, Salimans, Tim, Sutskever, Ilya (2018) Improving language understanding by generative pre-training. OpenAI.

Radford, Alec, Wu, Jeffrey, Child, Rewon, Luan, David, Amodei, Dario, Sutskever, Ilya (2019) Language models are unsupervised multitask learners. OpenAI Blog.

Radford, Alec, Kim, Jong Wook, Hallacy, Chris, Ramesh, Aditya, Goh, Gabriel, Agarwal, Sandhini, Sastry, Girish, Askell, Amanda, Mishkin, Pamela, Clark, Jack, et al. (2021) Learning transferable visual models from natural language supervision. International Conference on Machine Learning.

Radhakrishna Rao, C (1945) Information and accuracy attainable in the estimation of statistical parameters. Bulletin of the Calcutta Mathematical Society.

Radosavovic, Ilija, Kosaraju, Raj Prateek, Girshick, Ross, He, Kaiming, Dollar, Piotr (2020) Designing network design spaces. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

Radosavovic, Ilija, Johnson, Justin, Xie, Saining, Lo, Wan-Yen, Dollar, Piotr (2019) On network design spaces for visual recognition. Proceedings of the IEEE/CVF International Conference on Computer Vision.

Rae, Jack W, Borgeaud, Sebastian, Cai, Trevor, Millican, Katie, Hoffmann, Jordan, Song, Francis, Aslanides, John, Henderson, Sarah, Ring, Roman, Young, Susannah, et al. (2021) Scaling language models: Methods, analysis & insights from training gopher. ArXiv:2112.11446.

Raffel, Colin, Shazeer, Noam, Roberts, Adam, Lee, Katherine, Narang, Sharan, Matena, Michael, Zhou, Yanqi, Li, Wei, Liu, Peter J (2020) Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research.

Rajpurkar, Pranav, Zhang, Jian, Lopyrev, Konstantin, Liang, Percy (2016) SQuAD: 100,000+ questions for machine comprehension of text. ArXiv:1606.05250.

Ramachandran, Prajit, Zoph, Barret, Le, Quoc V (2017) Searching for activation functions. ArXiv:1710.05941.

Ramachandran, Prajit, Parmar, Niki, Vaswani, Ashish, Bello, Irwan, Levskaya, Anselm, Shlens, Jon (2019) Stand-alone self-attention in vision models. Advances in Neural Information Processing Systems.

Ramesh, Aditya, Pavlov, Mikhail, Goh, Gabriel, Gray, Scott, Voss, Chelsea, Radford, Alec, Chen, Mark, Sutskever, Ilya (2021) Zero-shot text-to-image generation. International Conference on Machine Learning.

Ramesh, Aditya, Dhariwal, Prafulla, Nichol, Alex, Chu, Casey, Chen, Mark (2022) Hierarchical text-conditional image generation with clip latents. ArXiv:2204.06125.

Ranzato, Marc-Aurelio, Boureau, Y-Lan, Chopra, Sumit, LeCun, Yann (2007) A unified energy-based framework for unsupervised learning. Artificial Intelligence and Statistics.

Rasmussen, Carl Edward, Williams, Christopher KI (2006) Gaussian Processes for Machine Learning. MIT Press.

Reddi, Sashank J, Kale, Satyen, Kumar, Sanjiv (2019) On the convergence of Adam and beyond. ArXiv:1904.09237.

Redmon, Joseph, Divvala, Santosh, Girshick, Ross, Farhadi, Ali (2016) You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

Redmon, Joseph, Farhadi, Ali (2018) YOLOv3: An incremental improvement. ArXiv:1804.02767.

Reed, Scott, De Freitas, Nando (2015) Neural programmer-interpreters. ArXiv:1511.06279.

Reed, Scott, Zolna, Konrad, Parisotto, Emilio, Colmenarejo, Sergio Gomez, Novikov, Alexander, Barth-Maron, Gabriel, Gimenez, Mai, Sulsky, Yury, Kay, Jackie, Springenberg, Jost Tobias, et al. (2022) A generalist agent. ArXiv:2205.06175.

Ren, Shaoqing, He, Kaiming, Girshick, Ross, Sun, Jian (2015) Faster R-CNN: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems.

Rendle, Steffen (2010) Factorization machines. 2010 IEEE International Conference on Data Mining.

Rendle, Steffen, Freudenthaler, Christoph, Gantner, Zeno, Schmidt-Thieme, Lars (2009) BPR: Bayesian personalized ranking from implicit feedback. Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence.

Revels, Jarrett, Lubin, Miles, Papamarkou, Theodore (2016) Forward-mode automatic differentiation in Julia. ArXiv:1607.07892.

Rezende, Danilo Jimenez, Mohamed, Shakir, Wierstra, Daan (2014) Stochastic backpropagation and approximate inference in deep generative models. International Conference on Machine Learning.

Rezende, Danilo, Mohamed, Shakir (2015) Variational inference with normalizing flows. International Conference on Machine Learning.

Riesenhuber, Maximilian, Poggio, Tomaso (1999) Hierarchical models of object recognition in cortex. Nature Neuroscience.

R.~T.~Rockafellar Convex Analysis. Princeton University Press.

Rolnick, David, Veit, Andreas, Belongie, Serge, Shavit, Nir (2017) Deep learning is robust to massive label noise. ArXiv:1705.10694.

Rosenbaum, Paul R, Rubin, Donald B (1983) The central role of the propensity score in observational studies for causal effects. Biometrika.

W.~Rudin Functional Analysis. McGraw-Hill.

Rumelhart, David E, Hinton, Geoffrey E, Williams, Ronald J (1988) Learning representations by back-propagating errors. Cognitive Modeling.

Olga Russakovsky, Jia Deng, Zhiheng Huang, Alexander C. Berg, Li Fei-Fei (2013) Detecting avocados to zucchinis: what have we done, and where are we going?. International Conference on Computer Vision (ICCV).

Russakovsky, Olga, Deng, Jia, Su, Hao, Krause, Jonathan, Satheesh, Sanjeev, Ma, Sean, Huang, Zhiheng, Karpathy, Andrej, Khosla, Aditya, Bernstein, Michael, et al. (2015) ImageNet large scale visual recognition challenge. International Journal of Computer Vision.

Russell, Stuart J, Norvig, Peter (2016) Artificial Intelligence: A Modern Approach. Pearson Education Limited.

Saharia, Chitwan, Chan, William, Saxena, Saurabh, Li, Lala, Whang, Jay, Denton, Emily, Ghasemipour, Seyed Kamyar Seyed, Ayan, Burcu Karagol, Mahdavi, S Sara, Lopes, Rapha Gontijo, et al. (2022) Photorealistic text-to-image diffusion models with deep language understanding. ArXiv:2205.11487.

D. Salinas, M. Seeger, A. Klein, V. Perrone, M. Wistuba, C. Archambeau (2022) Syne Tune: A library for Large Scale Hyperparameter Tuning and Reproducible Research. First Conference on Automated Machine Learning.

Salton, Gerard, Wong, Anita, Yang, Chung-Shu (1975) A vector space model for automatic indexing. Communications of the ACM.

Sanh, Victor, Debut, Lysandre, Chaumond, Julien, Wolf, Thomas (2019) DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. ArXiv:1910.01108.

Sanh, Victor, Webson, Albert, Raffel, Colin, Bach, Stephen H, Sutawika, Lintang, Alyafeai, Zaid, Chaffin, Antoine, Stiegler, Arnaud, Scao, Teven Le, Raja, Arun, et al. (2021) Multitask prompted training enables zero-shot task generalization. ArXiv:2110.08207.

Santurkar, Shibani, Tsipras, Dimitris, Ilyas, Andrew, Madry, Aleksander (2018) How does batch normalization help optimization?. Advances in Neural Information Processing Systems.

Sarwar, Badrul Munir, Karypis, George, Konstan, Joseph A, Riedl, John (2001) Item-based collaborative filtering recommendation algorithms.. Proceedings of 10th International Conference on World Wide Web.

Scao, Teven Le, Fan, Angela, Akiki, Christopher, Pavlick, Ellie, Ilic, Suzana, Hesslow, Daniel, Castagne, Roman, Luccioni, Alexandra Sasha, Yvon, Fran\ccois, Galle, Matthias, et al. (2022) BLOOM: A 176B-parameter open-access multilingual language model. ArXiv:2211.05100.

Schein, Andrew I, Popescul, Alexandrin, Ungar, Lyle H, Pennock, David M (2002) Methods and metrics for cold-start recommendations. Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.

Scholkopf, Bernhard, Burges, Chris, Vapnik, Vladimir (1996) Incorporating invariances in support vector learning machines. International Conference on Artificial Neural Networks.

B.~Scholkopf, R.~Herbrich, A. J. Smola A generalized representer theorem. Proceedings of the Annual Conference on Computational Learning Theory.

Scholkopf, Bernhard, Smola, Alexander J (2002) Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press.

Schuhmann, Christoph, Beaumont, Romain, Vencu, Richard, Gordon, Cade, Wightman, Ross, Cherti, Mehdi, Coombes, Theo, Katta, Aarush, Mullis, Clayton, Wortsman, Mitchell, et al. (2022) LAION-5B: An open large-scale dataset for training next generation image-text models. ArXiv:2210.08402.

Schuster, Mike, Paliwal, Kuldip K (1997) Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing.

Sedhain, Suvash, Menon, Aditya Krishna, Sanner, Scott, Xie, Lexing (2015) Autorec: Autoencoders meet collaborative filtering. Proceedings of the 24th International Conference on World Wide Web.

Sennrich, Rico, Haddow, Barry, Birch, Alexandra (2015) Neural machine translation of rare words with subword units. ArXiv:1508.07909.

Sergeev, Alexander, Del Balso, Mike (2018) Horovod: fast and easy distributed deep learning in TensorFlow. ArXiv:1802.05799.

Shannon, Claude Elwood A Mathematical Theory of Communication. The Bell System Technical Journal.

Shao, Huajie, Yao, Shuochao, Sun, Dachun, Zhang, Aston, Liu, Shengzhong, Liu, Dongxin, Wang, Jun, Abdelzaher, Tarek (2020) ControlVAE: Controllable variational autoencoder. Proceedings of the 37th International Conference on Machine Learning.

Shaw, Peter, Uszkoreit, Jakob, Vaswani, Ashish (2018) Self-attention with relative position representations. ArXiv:1803.02155.

Shoeybi, Mohammad, Patwary, Mostofa, Puri, Raul, LeGresley, Patrick, Casper, Jared, Catanzaro, Bryan (2019) Megatron-LM: Training multi-billion parameter language models using model parallelism. ArXiv:1909.08053.

Silver, David, Huang, Aja, Maddison, Chris J, Guez, Arthur, Sifre, Laurent, Van Den Driessche, George, Schrittwieser, Julian, Antonoglou, Ioannis, Panneershelvam, Veda, Lanctot, Marc, et al. (2016) Mastering the game of Go with deep neural networks and tree search. Nature.

B.~W. Silverman Density Estimation for Statistical and Data Analysis. Chapman and Hall.

Simard, Patrice Y, LeCun, Yann A, Denker, John S, Victorri, Bernard (1998) Transformation invariance in pattern recognition – tangent distance and tangent propagation. Neural Networks: Tricks of the Trade.

Simonyan, Karen, Zisserman, Andrew (2014) Very deep convolutional networks for large-scale image recognition. ArXiv:1409.1556.

Sindhwani, Vikas, Sainath, Tara N, Kumar, Sanjiv (2015) Structured transforms for small-footprint deep learning. ArXiv:1510.01722.

Sivic, Josef, Zisserman, Andrew (2003) Video Google: A text retrieval approach to object matching in videos. Proceedings of the IEEE International Conference on Computer Vision.

Smith, Shaden, Patwary, Mostofa, Norick, Brandon, LeGresley, Patrick, Rajbhandari, Samyam, Casper, Jared, Liu, Zhun, Prabhumoye, Shrimai, Zerveas, George, Korthikanti, Vijay, et al. (2022) Using DeepSpeed and Megatron to train Megatron-Turing NLG 530B, a large-scale generative language model. ArXiv:2201.11990.

Smola, Alexander, Narayanamurthy, Shravan (2010) An architecture for parallel topic models. Proceedings of the VLDB Endowment.

Snoek, J., Larochelle, H., Adams, R. (2012) Practical Bayesian Optimization of Machine Learning Algorithms. Advances in Neural Information Processing Systems 25.

Sohl-Dickstein, Jascha, Weiss, Eric, Maheswaranathan, Niru, Ganguli, Surya (2015) Deep unsupervised learning using nonequilibrium thermodynamics. International Conference on Machine Learning.

Song, Yang, Ermon, Stefano (2019) Generative modeling by estimating gradients of the data distribution. Advances in Neural Information Processing Systems.

Song, Yang, Sohl-Dickstein, Jascha, Kingma, Diederik P, Kumar, Abhishek, Ermon, Stefano, Poole, Ben (2021) Score-Based Generative Modeling through Stochastic Differential Equations. International Conference on Learning Representations.

Speelpenning, Bert (1980) Compiling fast partial derivatives of functions given by algorithms.

Spiegelhalter, David (2019) The Art of Statistics: Learning from Data. Penguin.

Srivastava, Nitish, Hinton, Geoffrey, Krizhevsky, Alex, Sutskever, Ilya, Salakhutdinov, Ruslan (2014) Dropout: a simple way to prevent neural networks from overfitting. Journal of Machine Learning Research.

Srivastava, Rupesh Kumar, Greff, Klaus, Schmidhuber, Jurgen (2015) Highway networks. ArXiv:1505.00387.

Srivastava, Aarohi, Rastogi, Abhinav, Rao, Abhishek, Shoeb, Abu Awal Md, Abid, Abubakar, Fisch, Adam, Brown, Adam R, Santoro, Adam, Gupta, Aditya, Garriga-Alonso, Adria, et al. (2022) Beyond the imitation game: quantifying and extrapolating the capabilities of language models. ArXiv:2206.04615.

Strang, Gilbert (1993) Introduction to Linear Algebra. Wellesley–Cambridge Press.

Su, Xiaoyuan, Khoshgoftaar, Taghi M (2009) A survey of collaborative filtering techniques. Advances in Artificial Intelligence.

Sukhbaatar, Sainbayar, Weston, Jason, Fergus, Rob (2015) End-to-end memory networks. Advances in Neural Information Processing Systems.

Sutskever, Ilya, Martens, James, Dahl, George, Hinton, Geoffrey (2013) On the importance of initialization and momentum in deep learning. International Conference on Machine Learning.

Sutskever, Ilya, Vinyals, Oriol, Le, Quoc V (2014) Sequence to sequence learning with neural networks. Advances in Neural Information Processing Systems.

Szegedy, Christian, Ioffe, Sergey, Vanhoucke, Vincent, Alemi, Alexander A (2017) Inception-v4, Inception-ResNet and the impact of residual connections on learning. 31st AAAI Conference on Artificial Intelligence.

Szegedy, Christian, Liu, Wei, Jia, Yangqing, Sermanet, Pierre, Reed, Scott, Anguelov, Dragomir, Erhan, Dumitru, Vanhoucke, Vincent, Rabinovich, Andrew (2015) Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

Szegedy, Christian, Vanhoucke, Vincent, Ioffe, Sergey, Shlens, Jon, Wojna, Zbigniew (2016) Rethinking the Inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

Tallec, Corentin, Ollivier, Yann (2017) Unbiasing truncated backpropagation through time. ArXiv:1705.08209.

Tan, Mingxing, Le, Quoc (2019) EfficientNet: Rethinking model scaling for convolutional neural networks. International Conference on Machine Learning.

Tang, Jiaxi, Wang, Ke (2018) Personalized top-n sequential recommendation via convolutional sequence embedding. Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining.

Taskar, Ben, Guestrin, Carlos, Koller, Daphne (2004) Max-margin Markov networks. Advances in Neural Information Processing Systems.

Tay, Yi, Dehghani, Mostafa, Bahri, Dara, Metzler, Donald (2020) Efficient transformers: A survey. ArXiv:2009.06732.

Tay, Yi, Dehghani, Mostafa, Rao, Jinfeng, Fedus, William, Abnar, Samira, Chung, Hyung Won, Narang, Sharan, Yogatama, Dani, Vaswani, Ashish, Metzler, Donald (2021) Scale efficiently: Insights from pre-training and fine-tuning transformers. ArXiv:2109.10686.

Taylor, Ross, Kardas, Marcin, Cucurull, Guillem, Scialom, Thomas, Hartshorn, Anthony, Saravia, Elvis, Poulton, Andrew, Kerkez, Viktor, Stojnic, Robert (2022) Galactica: A large language model for science. ArXiv:2211.09085.

Teye, Mattias, Azizpour, Hossein, Smith, Kevin (2018) Bayesian uncertainty estimation for batch normalized deep networks. ArXiv:1802.06455.

Thomee, Bart, Shamma, David A, Friedland, Gerald, Elizalde, Benjamin, Ni, Karl, Poland, Douglas, Borth, Damian, Li, Li-Jia (2016) YFCC100M: The new data in multimedia research. Communications of the ACM.

Thomee, Bart, Shamma, David A, Friedland, Gerald, Elizalde, Benjamin, Ni, Karl, Poland, Douglas, Borth, Damian, Li, Li-Jia (2016) YFCC100M: The new data in multimedia research. Communications of the ACM.

Thompson, Colin J (2015) Mathematical Statistical Mechanics. Princeton University Press.

Thoppilan, Romal, De Freitas, Daniel, Hall, Jamie, Shazeer, Noam, Kulshreshtha, Apoorv, Cheng, Heng-Tze, Jin, Alicia, Bos, Taylor, Baker, Leslie, Du, Yu, et al. (2022) LaMDA: Language models for dialog applications. ArXiv:2201.08239.

Tieleman, Tijmen, Hinton, Geoffrey (2012) Divide the gradient by a running average of its recent magnitude. COURSERA: Neural Networks for Machine Learning, Lecture 6.5-rmsprop.

Tikhonov, A. N., Arsenin, V. Y. (1977) Solutions of Ill-Posed Problems. W.H.~Winston.

Tolstikhin, Ilya O, Houlsby, Neil, Kolesnikov, Alexander, Beyer, Lucas, Zhai, Xiaohua, Unterthiner, Thomas, Yung, Jessica, Steiner, Andreas, Keysers, Daniel, Uszkoreit, Jakob, et al. (2021) MLP-mixer: An all-MLP architecture for vision. Advances in Neural Information Processing Systems.

Torralba, Antonio, Fergus, Rob, Freeman, William T (2008) 80 million tiny images: A large data set for nonparametric object and scene recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence.

Toscher, Andreas, Jahrer, Michael, Bell, Robert M (2009) The bigchaos solution to the Netflix grand prize. Netflix Prize Documentation.

Touvron, Hugo, Cord, Matthieu, Douze, Matthijs, Massa, Francisco, Sablayrolles, Alexandre, Jegou, Herve (2021) Training data-efficient image transformers & distillation through attention. International Conference on Machine Learning.

Touvron, Hugo, Lavril, Thibaut, Izacard, Gautier, Martinet, Xavier, Lachaux, Marie-Anne, Lacroix, Timothee, Roziere, Baptiste, Goyal, Naman, Hambro, Eric, Azhar, Faisal, et al. (2023a) LLaMA: Open and efficient foundation language models. ArXiv:2302.13971.

Touvron, Hugo, Martin, Louis, Stone, Kevin, Albert, Peter, Almahairi, Amjad, Babaei, Yasmine, Bashlykov, Nikolay, Batra, Soumya, Bhargava, Prajjwal, Bhosale, Shruti, et al. (2023b) LLaMA 2: Open foundation and fine-tuned chat models. ArXiv:2307.09288.

Treisman, Anne M, Gelade, Garry (1980) A feature-integration theory of attention. Cognitive Psychology.

Tsoumakas, Grigorios, Katakis, Ioannis (2007) Multi-label classification: An overview. International Journal of Data Warehousing and Mining.

Turing, Alan (1950) Computing machinery and intelligence. Mind.

Uijlings, Jasper RR, Van De Sande, Koen EA, Gevers, Theo, Smeulders, Arnold WM (2013) Selective search for object recognition. International Journal of Computer Vision.

V. Vapnik, A. Chervonenkis A note on one class of perceptrons. Automation and Remote Control.

V. Vapnik, A. Chervonenkis Uniform convergence of frequencies of occurence of events to their probabilities. Dokl.\ Akad.\ Nauk SSSR.

V. Vapnik, A. Chervonenkis On the uniform convergence of relative frequencies of events to their probabilities. Theory Probab. Appl..

V. Vapnik, A. Chervonenkis Theory of Pattern Recognition [in Russian]. Nauka.

V.~N. Vapnik, A.~Y. Chervonenkis Ordered risk minimization. Automation and Remote Control.

V. Vapnik, A. Chervonenkis The necessary and sufficient conditions for the uniform convergence of averages to their expected values. Teoriya Veroyatnostei i Ee Primeneniya.

V. Vapnik, A. Chervonenkis The necessary and sufficient conditions for consistency in the empirical risk minimization method. Pattern Recognition and Image Analysis.

Vapnik, Vladimir (1992) Principles of risk minimization for learning theory. Advances in Neural Information Processing Systems.

V. Vapnik Statistical Learning Theory. John Wiley & Sons.

V. Vapnik, A. Chervonenkis (1964) A note on one class of perceptrons. Automation and Remote Control.

V. Vapnik, A. Chervonenkis Uniform convergence of frequencies of occurence of events to their probabilities. Dokl.\ Akad.\ Nauk SSSR.

V. Vapnik, A. Chervonenkis On the uniform convergence of relative frequencies of events to their probabilities. Theory Probab. Appl..

V. Vapnik, A. Chervonenkis Theory of Pattern Recognition [in Russian]. Nauka.

V.~N. Vapnik, A.~Y. Chervonenkis Ordered risk minimization. Automation and Remote Control.

V. Vapnik, A. Chervonenkis Teoriya Raspoznavaniya Obrazov: Statisticheskie Problemy Obucheniya. (in Russian) [Theory of Pattern Recognition: Statistical Problems of Learning].

V. Vapnik, A. Chervonenkis The necessary and sufficient conditions for the uniform convergence of averages to their expected values. Teoriya Veroyatnostei i Ee Primeneniya.

V. Vapnik, A. Chervonenkis The necessary and sufficient conditions for consistency in the empirical risk minimization method. Pattern Recognition and Image Analysis.

Vapnik, Vladimir, Levin, Esther, Le Cun, Yann (1994) Measuring the VC-dimension of a learning machine. Neural Computation.

Vapnik, Vladimir, Levin, Esther, Le Cun, Yann (1994) Measuring the VC-dimension of a learning machine. Neural Computation.

V. Vapnik The Nature of Statistical Learning Theory. Springer.

V. Vapnik Statistical Learning Theory. John Wiley and Sons.

Vaswani, Ashish, Shazeer, Noam, Parmar, Niki, Uszkoreit, Jakob, Jones, Llion, Gomez, Aidan N, Kaiser, \Lukasz, Polosukhin, Illia (2017) Attention is all you need. Advances in Neural Information Processing Systems.

Wahba, Grace (1990) Spline Models for Observational Data. SIAM.

Waibel, Alex, Hanazawa, Toshiyuki, Hinton, Geoffrey, Shikano, Kiyohiro, Lang, Kevin J (1989) Phoneme recognition using time-delay neural networks. IEEE Transactions on Acoustics, Speech, and Signal Processing.

Wang, Yangzihao, Davidson, Andrew, Pan, Yuechao, Wu, Yuduo, Riffel, Andy, Owens, John D (2016) Gunrock: A high-performance graph processing library on the GPU. ACM SIGPLAN Notices.

Wang, Leyuan, Li, Mu, Liberty, Edo, Smola, Alex J (2018) Optimal message scheduling for aggregation. Networks.

Wang, Qiang, Li, Bei, Xiao, Tong, Zhu, Jingbo, Li, Changliang, Wong, Derek F, Chao, Lidia S (2019) Learning deep transformer models for machine translation. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics.

Wang, Haotao, Zhang, Aston, Zheng, Shuai, Shi, Xingjian, Li, Mu, Wang, Zhangyang (2022) Removing batch normalization boosts adversarial training. International Conference on Machine Learning.

Wang, Xuezhi, Wei, Jason, Schuurmans, Dale, Le, Quoc, Chi, Ed, Zhou, Denny (2023) Self-Consistency Improves Chain of Thought Reasoning in Language Models. International Conference on Learning Representations.

Warstadt, Alex, Singh, Amanpreet, Bowman, Samuel R (2019) Neural network acceptability judgments. Transactions of the Association for Computational Linguistics.

Wasserman, Larry (2013) All of Statistics: A Concise Course in Statistical Inference. Springer.

Watkins, Christopher JCH, Dayan, Peter (1992) Q-learning. Machine Learning.

Watson, Geoffrey S (1964) Smooth regression analysis. Sankhya: The Indian Journal of Statistics, Series A.

Wei, Jason, Bosma, Maarten, Zhao, Vincent Y, Guu, Kelvin, Yu, Adams Wei, Lester, Brian, Du, Nan, Dai, Andrew M, Le, Quoc V (2021) Finetuned language models are zero-shot learners. ArXiv:2109.01652.

Wei, Jason, Wang, Xuezhi, Schuurmans, Dale, Bosma, Maarten, Chi, Ed, Le, Quoc, Zhou, Denny (2022) Chain of thought prompting elicits reasoning in large language models. ArXiv:2201.11903.

Wei, Jason, Tay, Yi, Bommasani, Rishi, Raffel, Colin, Zoph, Barret, Borgeaud, Sebastian, Yogatama, Dani, Bosma, Maarten, Zhou, Denny, Metzler, Donald, et al. (2022) Emergent abilities of large language models. ArXiv:2206.07682.

Welling, Max, Teh, Yee W (2011) Bayesian learning via stochastic gradient Langevin dynamics. Proceedings of the 28th International Conference on Machine Learning (ICML-11).

Wengert, Robert Edwin (1964) A simple automatic derivative evaluation program. Communications of the ACM.

Werbos, Paul J (1990) Backpropagation through time: what it does and how to do it. Proceedings of the IEEE.

Wigner, Eugene P. (1958) On the distribution of the roots of certain symmetric matrices. Ann. Math..

Williams, Samuel, Waterman, Andrew, Patterson, David (2009) Roofline: An insightful visual performance model for floating-point programs and multicore architectures.

Wilson, Andrew G, Izmailov, Pavel (2020) Bayesian deep learning and a probabilistic perspective of generalization. Advances in Neural Information Processing Systems.

M. Wistuba, A. Rawat, T. Pedapati (2019) A survey on neural architecture search. ArXiv:1905.01392 [cs.LG].

M. Wistuba, N. Schilling, L. Schmidt-Thieme (2018) Scalable Gaussian process-based transfer surrogates for hyperparameter optimization. Machine Learning.

Wolpert, David H, Macready, William G (1995) No free lunch theorems for search.

Wood, Frank, Gasthaus, Jan, Archambeau, Cedric, James, Lancelot, Teh, Yee Whye (2011) The sequence memoizer. Communications of the ACM.

Wu, Chao-Yuan, Ahmed, Amr, Beutel, Alex, Smola, Alexander J, Jing, How (2017) Recurrent recommender networks. Proceedings of the 10th ACM International Conference on Web Search and Data Mining.

Wu, Yonghui, Schuster, Mike, Chen, Zhifeng, Le, Quoc V, Norouzi, Mohammad, Macherey, Wolfgang, Krikun, Maxim, Cao, Yuan, Gao, Qin, Macherey, Klaus, et al. (2016) Google's neural machine translation system: Bridging the gap between human and machine translation. ArXiv:1609.08144.

Wu, Bichen, Wan, Alvin, Yue, Xiangyu, Jin, Peter, Zhao, Sicheng, Golmant, Noah, Gholaminejad, Amir, Gonzalez, Joseph, Keutzer, Kurt (2018) Shift: A zero flop, zero parameter alternative to spatial convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

Xiao, Lechao, Bahri, Yasaman, Sohl-Dickstein, Jascha, Schoenholz, Samuel, Pennington, Jeffrey (2018) Dynamical isometry and a mean field theory of CNNs: How to train 10,000-layer vanilla convolutional neural networks. International Conference on Machine Learning.

Xiao, Han, Rasul, Kashif, Vollgraf, Roland (2017) Fashion-MNIST: a novel image dataset for benchmarking machine learning algorithms. ArXiv:1708.07747.

Xie, Saining, Girshick, Ross, Dollar, Piotr, Tu, Zhuowen, He, Kaiming (2017) Aggregated residual transformations for deep neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

Xiong, Wayne, Wu, Lingfeng, Alleva, Fil, Droppo, Jasha, Huang, Xuedong, Stolcke, Andreas (2018) The Microsoft 2017 conversational speech recognition system. 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

Xiong, Ruibin, Yang, Yunchang, He, Di, Zheng, Kai, Zheng, Shuxin, Xing, Chen, Zhang, Huishuai, Lan, Yanyan, Wang, Liwei, Liu, Tieyan (2020) On layer normalization in the transformer architecture. International Conference on Machine Learning.

Yamaguchi, Kouichi, Sakamoto, Kenji, Akabane, Toshio, Fujimoto, Yoshiji (1990) A neural network for speaker-independent isolated word recognition. First International Conference on Spoken Language Processing.

Yang, Zichao, Moczulski, Marcin, Denil, Misha, De Freitas, Nando, Smola, Alex, Song, Le, Wang, Ziyu (2015) Deep fried convnets. Proceedings of the IEEE International Conference on Computer Vision.

Yang, Zichao, Hu, Zhiting, Deng, Yuntian, Dyer, Chris, Smola, Alex (2016) Neural machine translation with recurrent attention modeling. ArXiv:1607.05108.

Yang, Zhilin, Dai, Zihang, Yang, Yiming, Carbonell, Jaime, Salakhutdinov, Russ R, Le, Quoc V (2019) XLNet: Generalized autoregressive pretraining for language understanding. Advances in Neural Information Processing Systems.

Ye, Mao, Yin, Peifeng, Lee, Wang-Chien, Lee, Dik-Lun (2011) Exploiting geographical influence for collaborative point-of-interest recommendation. Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval.

You, Yang, Gitman, Igor, Ginsburg, Boris (2017) Large batch training of convolutional networks. ArXiv:1708.03888.

Yu, Bin (1994) Rates of convergence for empirical processes of stationary mixing sequences. Annals of Probability.

Yu, Jiahui, Xu, Yuanzhong, Koh, Jing Yu, Luong, Thang, Baid, Gunjan, Wang, Zirui, Vasudevan, Vijay, Ku, Alexander, Yang, Yinfei, Karagol Ayan, Burcu, Hutchinson, Ben, Han, Wei, Parekh, Zarana, Li, Xin, Zhang, Han, Baldridge, Jason, Wu, Yonghui (2022) Scaling autoregressive models for content-rich text-to-image generation. ArXiv:2206.10789.

Zaheer, Manzil, Reddi, Sashank, Sachan, Devendra, Kale, Satyen, Kumar, Sanjiv (2018) Adaptive methods for nonconvex optimization. Advances in Neural Information Processing Systems.

Zeiler, Matthew D (2012) ADADELTA: an adaptive learning rate method. ArXiv:1212.5701.

Zeiler, Matthew D, Fergus, Rob (2013) Stochastic pooling for regularization of deep convolutional neural networks. ArXiv:1301.3557.

Zhang, Tong (2004) Statistical behavior and consistency of classification methods based on convex risk minimization. Annals of Statistics.

Zhang, Wei, Tanida, Jun, Itoh, Kazuyoshi, Ichioka, Yoshiki (1988) Shift-invariant pattern recognition neural network and its optical architecture. Proceedings of Annual Conference of the Japan Society of Applied Physics.

Yifu Zhang, Peize Sun, Yi Jiang, Dongdong Yu, Zehuan Yuan, Ping Luo, Wenyu Liu, Xinggang Wang (2021) ByteTrack: Multi-object tracking by associating every detection box. ArXiv:2110.06864.

Zhang, Aston, Tay, Yi, Zhang, Shuai, Chan, Alvin, Luu, Anh Tuan, Hui, Siu Cheung, Fu, Jie (2021) Beyond fully-connected layers with quaternions: Parameterization of hypercomplex multiplications with 1/n parameters. International Conference on Learning Representations.

Zhang, Shuai, Yao, Lina, Sun, Aixin, Tay, Yi (2019) Deep learning based recommender system: A survey and new perspectives. ACM Computing Surveys.

Zhang, Chiyuan, Bengio, Samy, Hardt, Moritz, Recht, Benjamin, Vinyals, Oriol (2021) Understanding deep learning (still) requires rethinking generalization. Communications of the ACM.

Zhang, Susan, Roller, Stephen, Goyal, Naman, Artetxe, Mikel, Chen, Moya, Chen, Shuohui, Dewan, Christopher, Diab, Mona, Li, Xian, Lin, Xi Victoria, et al. (2022) OPT: Open pre-trained transformer language models. ArXiv:2205.01068.

Zhang, Zhuosheng, Zhang, Aston, Li, Mu, Smola, Alex (2023) Automatic chain of thought prompting in large language models. International Conference on Learning Representations.

Zhang, Zhuosheng, Zhang, Aston, Li, Mu, Zhao, Hai, Karypis, George, Smola, Alex (2023) Multimodal Chain-of-Thought Reasoning in Language Models. ArXiv:2302.00923.

Zhao, Zhong-Qiu, Zheng, Peng, Xu, Shou-tao, Wu, Xindong (2019) Object detection with deep learning: A review. IEEE Transactions on Neural Networks and Learning Systems.

Zhou, Denny, Scharli, Nathanael, Hou, Le, Wei, Jason, Scales, Nathan, Wang, Xuezhi, Schuurmans, Dale, Bousquet, Olivier, Le, Quoc, Chi, Ed (2023) Least-to-most prompting enables complex reasoning in large language models. International Conference on Learning Representations.

Zhu, Yukun, Kiros, Ryan, Zemel, Rich, Salakhutdinov, Ruslan, Urtasun, Raquel, Torralba, Antonio, Fidler, Sanja (2015) Aligning books and movies: Towards story-like visual explanations by watching movies and reading books. Proceedings of the IEEE International Conference on Computer Vision.

Zhu, Jun-Yan, Park, Taesung, Isola, Phillip, Efros, Alexei A (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision.

Zoph, Barret, Le, Quoc V (2016) Neural architecture search with reinforcement learning. ArXiv:1611.01578.