Accelerating Production LLMs with Combined Token/Embedding Speculators

Autor: Wertheimer, Davis, Rosenkranz, Joshua, Parnell, Thomas, Suneja, Sahil, Ranganathan, Pavithra, Ganti, Raghu, Srivatsa, Mudhakar

This technical report describes the design and training of novel speculative decoding draft models, for accelerating the inference speeds of large language models in a production environment. By conditioning draft predictions on both context vectors

Externí odkaz: http://arxiv.org/abs/2404.19124

Leriche Syndrome in the Setting of Coronary Artery Bypass Grafting

Autor: Tveter Kevin, Bozek John, Puette Jeffrey, E Henrickson Roy, Ranganathan Pavithra, B Ellison Matthew

Publikováno v: Translational Perioperative and Pain Medicine. 6

Externí odkaz: https://explore.openaire.eu/search/publication?articleId=doi_________::fe3de52032e558b0411f948e65683522
https://doi.org/10.31480/2330-4871/088

Tento výsledek nelze pro nepřihlášené uživatele zobrazit.
K zobrazení výsledku je třeba se přihlásit.

Machine Learning Applied to Registry Data: Development of a Patient-Specific Prediction Model for Blood Transfusion Requirements During Craniofacial Surgery Using the Pediatric Craniofacial Perioperative Registry Dataset

Autor: Jalali, Ali, Lonsdale, Hannah, Zamora, Lillian V., Ahumada, Luis, Nguyen, Anh Thy H., Rehman, Mohamed, Fackler, James, Stricker, Paul A., Fernandez, Allison M., Abruzzese, Christopher, Apuya, Jesus, Bhandari, Angelina, Beethe, Amy, Benzon, Hubert, Binstock, Wendy, Bradford, Victoria, Brzenski, Alyssa, Budac, Stefan, Busso, Veronica, Chhabada, Surendrasingh, Chiao, Franklin, Cladis, Franklyn, Claypool, Danielle, Collins, Michael, Correll, Lynnie, Costandi, Andrew, Dabek, Rachel, Dalesio, Nicholas, Echeverry, Piedad, Falcon, Ricardo, Fernandez, Patrick, Fiadjoe, John, Gangadharan, Meera, Gentry, Katherine, Glover, Chris, Goobie, Susan M., Gosman, Amanda, Grivoyannis, Anastasia, Grap, Shannon, Gries, Heike, Griffin, Allison, Hajduk, John, Haas, Thorsten, Hall, Rebecca, Hansen, Jennifer, Hetmaniuk, Mali, Homi, H. Mayumi, Hsieh, Vincent, Huang, Henry, Ingelmo, Pablo, Ivanova, Iskra, Jain, Ranu, Kanmanthreddy, Siri, Kars, Michelle, King, Mike, Koller, John, Kowalczyk-Derderian, Courtney, Kugler, Jane, Labovsky, Kristen, Lakheeram, Indrani, Lazar, Alina, Lee, Andrew, Lee, Jennifer, Luis Martinez, Jose, Masel, Brian, Mason, Aaron, Medellin, Eduardo, Mehta, Vivek, Meier, Petra, Mitzel Levy, Heather, Muhly, Wallis T., Muldowney, Bridget, Nelson, Jonathon, Nicholson, Julie, Nguyen, Kim-Phuong, Nguyen, Thanh, Owens-Stubblefield, Margaret, Pankratz, Matt, Ramesh Parekh, Uma, Patel, Jasmine, Patel, Roshan, Perez-Pradilla, Carolina, Petersen, Timothy, Post, Julian, Poteet-Schwartz, Kim, Ranganathan, Pavithra, Reddy, Srijaya, Reid, Russell, Ricketts, Karene, Rodgers McCormick, Megan, Ryan, Laura, Sbrollini, Kaitlyn, Seidman, Peggy, Singh, Davinder, Singhal, Neil R., Skitt, Rochelle, Soneru, Codruta, Sorial, Emad, Spitznagel, Rachel, Stubbeman, Bobbie, Sunder, Rani, Sung, Wai, Syed, Tariq, Szmuk, Peter, Taicher, Brad M., Taylor, Jenna, Thompson, Douglas, Tretault, Lisa, Ungar-Kastner, Galit, Wieser, John, Wong, Karen, Yates, Hannah

Publikováno v: Anesthesia & Analgesia; January 2021, Vol. 132 Issue: 1 p160-171, 12p

Tento výsledek nelze pro nepřihlášené uživatele zobrazit.
K zobrazení výsledku je třeba se přihlásit.